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Statement  of  the  Problem 
"Is  the  Air  Force  Institute  of  Technology  (AFIT) 
at  Wright-Patterson  AFB , Ohio,  necessary  [1:7]?"  This 
question  and  others  are  being  asked  of  the  Department  of 
Defense  by  Congress  in  efforts  to  cut  down  on  government 
spending.  The  House  Committee  on  Appropriations  commented 
that 

In  some  respects  graduate  education  has  become 
just  another  ingredient  in  a successful  officer  career 
even  though  in  many  cases  it  cannot  be  shown  that  this 
additional  training  is  necessary  [22:23], 

Thus,  a continuing  need  exists  to  determine  the  usefulness 

of  the  graduate  degree  earned  at  the  AFIT  School  of  Systems 

and  Logistics  (18) . 

Background  and  Justification 
The  need  for  higher  education  in  the  Air  Force  can 
be  traced  back  to  the  early  days  of  powered  flight  when 
aviation  technology  was  increasing  and  changing  at  tremen- 
dous rates.  Before  1919,  the  Massachusetts  Institute  of 
Technology  fulfilled  that  need.  Since  then,  AFIT  has  grown 
to  become  the  primary  manager  of  the  Air  Force's  advanced 
educational  programs  (23:3). 


AFIT  formally  became  designated  the  Air  Force 
Institute  of  Technology  in  1947  when  the  Air  Force  became 
a separate  service  (23:3).  By  1958,  the  School  of  Logistics 
joined  the  already  existing  School  of  Engineering.  In  April 
1960,  the  School  of  Engineering  was  accredited  as  a master's 
degree-level  institution.  In  1963,  the  School  of  Logistics 
was  redesignated  the  School  of  Systems  and  Logistics  and 
was  given  similar  graduate  accreditation  by  the  North 
Central  Associate  of  Colleges  and  Schools  (12:2). 

The  current  mission  of  AFIT  is 

...  to  plan,  organize,  conduct,  and  administer 
degree-granting  and  continuing  education  programs  in 
engineering,  systems  and  logistics,  civil  engineering, 
management,  medicine,  and  other  fields  ...  in 
response  to  United  States  Air  Force  and  Department 
of  Defense  requirements  [23:2]. 

In  order  to  accomplish  this  mission,  AFIT  administrators 

must  continually  analyze  the  resources  of  higher  education 

and  assess  the  Air  Force's  educational  requirements  (23:2). 

In  this  respect,  AFIT  recognizes  the  importance  of  job- 

related  education,  education  which  civilian  industry  is 

now  discovering  its  managers  need  but  have  not  been  getting 

in  the  past  (17:81). 

That  the  AFIT  Graduate  School  of  Systems  and  Logis- 
tics strives  to  meet  job-related  needs  is  described  in  its 
mission  statement: 

...  to  further  professional  development  of 
selected  personnel  in  modern  management  procedures, 
with  a searching  analysis  of  the  means  whereby 
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improvements  can  be  made  using  human,  material,  and 
financial  resources  . . . [through]  conduct  [of] 
accredited  management  programs,  designed  to  develop 
a cadre  of  managers  in  the  fields  of  logistics  and 
facilities  management  [9:2]. 

The  major  curriculum  areas  of  Procurement,  Facilities  Man- 
agement, Acquisition  Logistics,  International  Logistics, 
and  Logistics  Management  are  indicative  of  the  Systems  and 
Logistics  School's  continuing  effort  to  meet  the  job- 
related  needs  of  the  Air  Force  manager  (9:5).  To  accomplish 
these  needs,  the  Graduate  School  of  Systems  and  Logistics 
strives  to  meet  six  objectives: 

1.  Develop  a higher  degree  of  understanding  for  and 
appreciation  of  the  individual's  role  in  accomplish- 
ing his  organization's  mission. 

2.  Provide  a foundation  for  the  quantitative  analysis 
of  systems  and  procedures. 

3.  Develop  an  improved  ability  to  use  the  basic  com- 
municative arts  as  more  effective  tools  of  manage- 
ment. 

4.  Provide  an  opportunity  for  training  and  experience 
in  the  use  of  research  theories  and  techniques  as 
applied  to  actual  military  problems. 

5.  Apply  current  management  principles  in  the  exist- 
ing military  context. 

6.  Develop  capability  in  data  processing,  financial 
management  and  budget  controls  as  applied  to  sys- 
tems and  procedures  [9:2-3], 

Successful  accomplishment  of  these  six  objectives 
contributes  immensely  to  the  development  of  knowledgeable 
managers,  but  at  a cost  of  $32,316  per  person  educated 
(12:99).  Congress  is  voicing  its  concern  over  this  spend- 
ing, especially  with  the  current  shortage  of  officers  in 
the  rated  career  field  (4:3).  With  the  loss  of  these  opera- 
tions people,  Congress  questions  the  value  of  spending  to 
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send  officers  through  AFIT.  "There  is  a vast  amount  of 
manpower  going  to  graduate  studies  that  could  be  used 
instead  to  better  man  the  operational  force  structure 
(1:7]."  Yet,  this  criticism  is  countered  by  Lieutenant 
General  John  B.  McPherson  in  an  article  published  in 
National  Defense,  where  he  equates  graduate  education  to 
greater  military  efficiency: 

Attaining  higher  levels  of  professionalism  and 
competence  by  members  of  the  military  leads  to  better 
managed  organizations,  improved  performance,  and  the 
ability  to  accomplish  more  with  fewer  people,  result- 
ing in  greater  national  security  and  a lower  defense 
budget  [16:43]. 

Because  of  the  high  cost  of  advanced  degree  pro- 
grams and  Congressional  doubt  about  the  usefulness  of  such 
programs,  the  continuing  need  to  justify  AFIT's  School  of 
Systems  and  Logistics  is  a practical  and  important  research 
project. 


Literature  Review 

The  problem  identified  for  the  study  was  a deter- 
mination of  the  usefulness  of  the  Graduate  Logistics  Pro- 
gram as  perceived  by  graduates.  The  bulk  of  the  research 
in  this  area  has  been  conducted  by  Graduate  Logistics 
students.  Therefore,  it  is  essential  that  a review  of 
pertinent  studies  be  made  in  order  to  become  familiar  with 
other  approaches  to  the  problem.  Also,  a review  of  litera- 
ture addressing  the  importance  of  higher  education  to 
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industry  will  be  included  to  illustrate  its  impact  upon  the 
manager  now  being  hired  by  industry  and  the  Air  Force. 

Theses  Review 

In  a study  conducted  in  1965,  Lieutenant  Colonel 
Allen  C.  Hart  evaluated  the  "utilization  of  the  education 
received,  the  extent  to  which  course  objectives  were  met, 
and  the  curriculum  [11:7]"  of  the  School  of  Systems  and 
Logistics.  Using  the  hypothesis  approach  and  the  question- 
naire instrument.  Hart  surveyed  students  graduating  in 
classes  1963A  through  1964B  (11:7).  These  graduates  indi- 
cated that  the  course  objectives  were  adequately  accom- 
plished and  that  the  curriculum  was  appropriate;  however, 
too  much  emphasis  was  placed  on  the  quantitative  courses 
(11:48).  In  his  conclusion.  Hart  wrote  that 

The  Graduate  Logistics  Program  is  fulfilling  the 
role,  mission,  and  objectives  for  which  it  was  designed. 
It  does  provide  an  education  to  selected  Logisticians 
and  will  provide  each  student  with  the  managerial  tools, 
both  quantitative  and  qualitative,  necessary  to  solve 
complex  logistics  and  weapons  systems  problems  [11:57]. 

In  1968,  Second  Lieutenants  Robert  Cook  and  John  E. 
Greene  extended  Lieutenant  Colonel  Hart's  study  and  sought 
to  determine  if  there  existed  a high  positive  correlation 
between  the  emphasis  placed  on  subjects  taught  in  the  Gradu- 
ate Logistics  Program  and  the  needs  in  the  field  as  per- 
ceived by  its  graduates  (3:85).  They  also  sought  to  deter- 
mine if  the  positions  held  by  graduates  of  the  program  were 
commensurate  with  the  additional  education  that  this  group 

I 
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had  received  (3:86).  Again,  a questionnaire  was  used. 

Data  obtained  from  a survey  of  graduates  between  1965  and 
1967  were  used  in  answering  the  researchers'  questions. 

The  graduates  felt  that  communicative  skills  received  the 
greatest  emphasis  in  the  field  and  should  be  stressed  more 
in  the  curriculum.  Although  Cook  and  Greene  found  that 
other  objectives  could  use  more  emphasis  in  the  classroom 
as  well,  they  concluded  overall  that  the  School  "does  teach 
subjects  which  the  graduates  both  need  and  use  in  the 
field  [3:95]." 

In  1971,  Captains  Jerry  W.  Hale  and  Basil  E.  Rooney 
continued  studying  the  usefulness  of  the  Graduate  Logistics 
Program.  They  sought  to  determine  if  there  existed  a sig- 
nificant difference  in  the  managerial  performance  of  logis- 
tics managers  who  had  graduated  from  the  School  of  Systems 
and  Logistics  and  those  who  had  no  graduate  education 
(10:11).  In  order  to  do  this,  they  developed  a question- 
naire consisting  of  forty  dimensions  of  managerial  perform- 
ance (10:13).  Hale  and  Rooney  surveyed  graduates  and  non- 
graduates, as  well  as  supervisors  of  both  groups.  The 
results  of  the  survey  supported  the  conclusion  that  the  per- 
formance of  the  graduates  was  superior  to  that  of  non- 
graduates on  certain  aspects  of  the  managerial  job.  The 
aspects  in  which  AFIT  graduates  excelled  were  decision 
making,  performance  style,  planning,  communication,  and 
general  evaluation  (10:40).  Hale  and  Rooney  were  unable  to 
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had  received  (3:86).  Again,  a questionnaire  was  used. 

Data  obtained  from  a survey  of  graduates  between  1965  and 
1967  were  used  in  answering  the  researchers'  questions. 

The  graduates  felt  that  communicative  skills  received  the 
greatest  emphasis  in  the  field  and  should  be  stressed  more 
in  the  curriculum.  Although  Cook  and  Greene  found  that 
other  objectives  could  use  more  emphasis  in  the  classroom 
as  well,  they  concluded  overall  that  the  School  "does  teach 
subjects  which  the  graduates  both  need  and  use  in  the 
field  [3:95] . " 

In  1971,  Captains  Jerry  W.  Hale  and  Basil  E.  Rooney 
continued  studying  the  usefulness  of  the  Graduate  Logistics 
Program.  They  sought  to  determine  if  there  existed  a sig- 
nificant difference  in  the  managerial  performance  of  logis- 
tics managers  who  had  graduated  from  the  School  of  Systems 
and  Logistics  and  those  who  had  no  graduate  education 
(10:11).  In  order  to  do  this,  they  developed  a question- 
naire consisting  of  forty  dimensions  of  managerial  perform- 
ance (10:13).  Hale  and  Rooney  surveyed  graduates  and  non- 
graduates, as  well  as  supervisors  of  both  groups.  The 
results  of  the  survey  supported  the  conclusion  that  the  per- 
formance of  the  graduates  was  superior  to  that  of  non- 
graduates on  certain  aspects  of  the  managerial  job.  The 
aspects  in  which  AFIT  graduates  excelled  were  decision 
making,  performance  style,  planning,  communication,  and 
general  evaluation  (10:40).  Hale  and  Rooney  were  unable  to 


make  a conclusion  about  the  overall  performance  of  gradu- 
ates, however.  They  suggested  that  perhaps  the  selection 
technique  used  by  the  Program  selects  those  candidates  who 
are  capable  managers  to  begin  with;  the  Program  further 
enriches  them  with  the  graduate  management  instruction 
(10:45) . 

The  next  year,  Captains  Joseph  Latt  and  Rick  Harrel- 
son  studied  the  image  of  the  School  of  Systems  and  Logis- 
tics as  perceived  by  senior  logistics  managers.  Using  the 
questionnaire  for  data  collection,  they  concluded  that  the 
School,  along  with  its  graduates,  was  held  in  high  regard 
by  the  logistics  managers  (13:41). 

In  1973,  Major  Phillip  G.  Loignan  and  Captain  John 
T.  Rademacher  completed  a student  thesis  concerned  with 
curriculum  objectives  and  whether  these  objectives  were 
appropriate  for  subsequent  operational  use  (15:2).  They 
surveyed  active  duty  Air  Force  officers  who  had  graduated 
from  the  School  of  Systems  and  Logistics  between  1963  and 
1970.  Based  on  the  responses  of  331  such  graduates, 

Loignan  and  Rademacher  concluded  that  the  curriculum  was 
appropriate,  but  with  some  overemphasis  on  linear  program- 
ming and  mathematical  model  building  (15:87). 

Captains  William  N.  Crowder  and  James  A.  Davidson 
extended  the  research  on  the  usefulness  of  the  Graduate 
Logistics  Program  with  their  student  thesis  in  1978.  They 
sought  to  analyze 
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. . . the  extent  to  which  graduates  of  the  many 
USAF-sponsored  graduate  education  programs  are  using 
those  skills  attained  through  or  precipitated  by  the 
graduate  study  process  [5:1]. 

Crowder  and  Davidson  developed  a questionnaire  and  dis- 

I 

tributed  it  to  members  of  the  1971A  to-1975B  classes.  In 
addition,  they  surveyed  these  graduates'  immediate  super- 
visors with  an  almost  identical  questionnaire  in  order  to 
compare  each  group's  perceptions  (5:11).  Their  primary 
objective  was  to  determine  the  extent  that  the  graduate 
used  his  logistics  education  in  his  or  her  current  assign- 
ment (5:9).  Crowder  and  Davidson  reached  several  conclu- 
sions based  on  an  analysis  of  responses  to  the  survey. 

First,  they  concluded  that  the  graduates  felt  that  the 
AFIT  Logistics  program  was  useful.  Also,  supervisors  had 
the  same  opinion  of  the  program  as  did  the  graduates . How- 
ever, supervisors  actually  perceived  the  program  to  be  more 
useful  than  graduates  expected.  Finally,  Crowder  and  David- 
son found  that  graduates  felt  that  they  could  be  better 
utilized  in  positions  other  than  those  they  currently  held 
(5:58) . 

Other  Literature 

The  relevance  of  industry-related  higher  education 
is  of  growing  concern  to  industry.  In  the  past,  educa- 
tional evaluation  methods  normally  concerned  performance 
measures  such  as  salary  and  position,  rather  than  relating 
educational  output  and  objective  fulfillment  (10:7).  It 
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is  important  to  note  that  the  idea  of  output  and  objectives 
in  education  is  rapidly  gaining  wide  acceptance  in  the 
public  education  sector  (6:1).  J.  Sterling  Livingston 
pointed  out  that  management  education  does  little  to 
improve  on-the-job  performance  of  graduates  (14:79).  Also, 
Lewis  C.  Solmon  wrote  that  "the  educational  system  is 
improperly  preparing  students  to  face  the  world  of  work 
[20:3]."  However,  as  has  been  indicated,  previous  studies 
refute  this  position  where  AFIT  graduates  are  concerned. 

Despite  these  studies  indicating  the  usefulness  of 
the  Graduate  Logistics  program,  AFIT  and  the  overall  Depart- 
ment of  Defense  (DOD)  education  program  is  being  criti- 
cized. The  Air  Force  has  2738  validated  graduate  degree 
positions  in  the  administration/management  career  field. 
While  3500  personnel  possessing  graduate  management  degrees 
are  required  to  keep  the  graduate  personnel  pipeline  and 
system  filled,  there  are  10,754  personnel  holding  graduate 
degrees  in  the  management  area  (22:24).  The  House  Committee 
on  Appropriations  criticized  this  excess  in  review  of  the 
DOD  Appropriation  Bill  for  1979: 

The  Department  of  Defense  fiscal  year  1979  request 
for  professional  education  and  development  totals  over 
$400  million,  including  the  pay  and  allowance  of  the 
individuals  receiving  the  training.  Not  only  is  this 
a tremendous  cost  in  terms  of  actual  outlay  of  dollars, 
but  also  in  terms  of  the  talents  of  high  potential 
individuals  who  will  not  be  available  to  the  Department 
of  Defense  for  one  to  two  years  while  undergoing  train- 
ing which  is,  in  many  instances,  of  questionable  neces- 
sity [22:29] . 
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The  Department  of  Defense  is  continually  faced  with 
a budget  that  allows  few  luxuries.  It  is  important  that 
an  institution  such  as  the  Air  Force  Institute  of  Technology 
be  continually  evaluated  to  assess  its  worth.  The  impor- 
tance of  such  evaluations  was  highlighted  during  hearings 
on  the  DOD  FY79  Appropriations  Bill.  The  House  Committee 
on  Appropriations  recommended  that  the  DOD  "reassess  the 
necessity  for  operating  both  the  Naval  Postgraduate  School 
and  the  Air  Force  Institute  of  Technology  [22:29]."  The 
objectives  of  this  research  are  thus  directed  toward  assess- 
ing the  usefulness  of  the  AFIT  School  of  Systems  and  Logis- 
tics. 

Objectives 

The  main  objective  of  this  study  is  to  determine 
the  extent  to  which  graduates  of  the  AFIT  School  of  Systems 
and  Logistics  have  used  the  knowledge  obtained  from  their 
graduate  education  in  follow-on  assignments.  Supporting 
objectives  are  to: 

1.  Analyze  the  possibility  of  enhanced  promotion 
potential  resulting  from  an  AFIT  education  as  perceived  by 
alumni . 

2.  Determine  and  analyze  the  overall  usefulness 
of  the  AFIT  graduate  management  education  as  perceived  by 
alumni . 
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3.  Determine  the  perception  of  usefulness  of  their 
immediate  supervisors  as  perceived  by  graduate  respondents. 

4.  Determine  the  usefulness  of  graduate  courses 
in  follow-on  assignments  as  perceived  by  alumni. 

5.  Determine  the  appropriateness  of  follow-on 
assignments  as  perceived  by  graduates. 

6.  Distinguish  between  rated  graduates'  percep- 
tions of  usefulness  and  those  of  other  graduates. 

7.  Determine  whether  perceptions  of  usefulness 
differ  among  graduates  of  different  time  periods. 

Research  Questions 

Questions  addressed  in  the  research  are: 

1.  Is  the  military  graduate  more  "promotable"  as 
a result  of  having  attended  the  school? 

2.  Does  the  School  of  Systems  and  Logistics  pro- 
vide an  education  which  is  useful  to  the  graduate  in  his 
job  and  his  Air  Force  career? 

3.  Do  rated  graduates  derive  as  much  usefulness 
from  their  graduate  education  as  nonrated  graduates? 

4.  Are  the  courses  offered  in  the  graduate  pro- 
gram providing  the  education  needed  by  the  graduate? 

5.  Is  the  Air  Force  effectively  assigning  gradu- 
ates to  jobs  that  require  an  advanced  education? 
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CHAPTER  II 


METHODOLOGY 

Overview 

After  establishing  the  problem  and  research  objec- 
tives, procedures  for  achieving  these  objectives  were 
developed.  First,  the  population  was  defined.  Next,  a 
method  of  gathering  data  was  developed.  Finally,  the  data 
analysis  techniques  and  procedures  to  be  used  to  answer  the 
research  questions  were  developed. 

Population 

Data  were  gathered  from  a single  population — the 
opinions  of  those  active  duty  Air  Force  officers  who  are 
graduates  of  the  graduate  management  programs  offered  by 
the  AFIT  School  of  Systems  and  Logistics.  Members  of 
classes  1963  through  1978B  were  surveyed.  Individuals  in 
the  process  of  accomplishing  a permanent  change  of  station 
during  the  survey  period  were  excluded  for  practical  con- 
siderations. 


The  Survey  Instrument 

General 

Because  the  participants  in  this  survey  were  dis- 
persed over  wide  geographical  areas,  a mailed  questionnaire 
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was  considered  to  be  the  most  reasonable  survey  instrument 
for  data  collection.  A decided  advantage  of  the  mailed 
questionnaire  is  its  associated  cost.  People  can  be 
reached  at  a fraction  of  the  cost  of  personal  interviews. 
Often,  more  time  can  be  used  in  answering  the  questionnaire, 
helping  assure  that  questions  are  answered  with  more  care. 

In  addition  to  this  advantage,  a respondent  is  more  likely 
to  divulge  information  that  is  of  a personal  nature — more 
so  than  in  a personal  interview.  Also,  there  is  no  inter- 
viewer present  to  bias  the  answers  by  incorrectly  recording 
the  information  (2:77-78). 

Even  though  the  mailed  questionnaire  was  considered 
to  be  the  most  practical  instrument  in  this  survey,  several 
disadvantages  restrict  its  use  and  should  be  addressed. 

For  example,  the  degree  of  representativeness  of  the  survey 
may  be  difficult  to  determine.  This  results  from  the  fact 
that  a relatively  large  percentage  of  mailed  questionnaires 
may  not  be  returned.  Also,  some  questions  may  be  omitted 
or  incorrectly  answered  because  they  were  misunderstood. 

In  these  ways,  therefore,  use  of  the  mailed  questionnaire 
may  result  in  valuable  information  not  being  received  that 
could  otherwise  be  obtained  in  a personal  interview  (2:78). 

These  disadvantages  do  not  present  significant 
problems  as  they  pertain  to  this  study.  In  addressing  the 
problem  of  nonresponse,  several  factors  need  to  be  con- 
sidered. First  of  all,  respondent  anonymity  is  a basic 
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premise  of  this  questionnaire  in  order  to  assure  the  respon- 
dent that  his  candid  answers  will  in  no  way  affect  his 
career.  This  guarantee,  however,  will  probably  increase 
nonresponse  bias  since  a follow-up  mailing  of  questionnaires 
to  those  subjects  who  initially  failed  to  respond  is  not 
possible.  But,  since  this  study  is  descriptive  and  not 
inferential  in  nature,  nonresponse  has  the  effect  only  of 
reducing  the  number  of  subjects  described.  As  far  as  reduc- 
ing the  amount  of  valuable  information  that  could  otherwise 
be  obtained  by  a personal  interview,  we  feel  that  the 
sixty- two  questions  (sixty-one  multiple  choice  and  one  open- 
end — refer  to  Appendix  A)  will  provide  all  the  data  needed 
to  fulfill  the  research  objectives. 


Questionnaire  Structure 

A questionnaire  developed  for  the  Crowder/Davidson 
thesis  study  and  subsequently  modified  to  aid  in  addressing 
the  research  objectives  of  this  study  was  used  (refer  to 
Appendix  A) . The  questionnaire  was  divided  into  four  sec- 
tions: demographic  data,  assignment /promotion  information, 
education  usefulness/ job  requirements,  and  an  open-end 
free  response  question. 

The  demographic  section  (questions  1-13)  is  con- 
cerned with  gathering  descriptive  information  such  as  organi- 
zational levels,  major  commands.  Air  Force  Specialty  Codes, 


I 


14 


time  in  present  assignment,  and  graduate  class  as  pertains 
to  each  respondent. 

The  assignment/promotion  information  section 
(questions  14-21)  contains  questions  intended  to  provide 
information  about  the  assignments /promo tability  of  AFIT 
graduates  as  a group  compared  to  all  Air  Force  officers. 

In  addition  to  asking  for  graduates'  perceptions,  this 
section  also  addresses  the  graduates'  actual  promotion 
history  in  secondary  and  primary  zone  promotions. 

The  education  usefulness/ job  requirements  informa- 
tion section  (questions  22-51)  contains  questions  concerned 
with  usefulness/appropriateness  of  the  AFIT  Logistics  Pro- 
gram and  the  requirements  of  graduates'  jobs.  Within  this 
section,  the  graduates'  general  perceptions  of  usefulness 
of  the  logistics  program  are  addressed  (questions  22-25 
and  57-61)  as  well  as  the  graduates'  perceptions  of  how 
their  supervisors  view  the  usefulness  of  the  program  (ques- 
tions 26-30) . Finally,  graduates  were  asked  questions  con- 
cerning what  abilities  are  required  of  them  on  the  job. 
These  questions  (31-56)  are  related  to  specific  courses 
offered  in  the  curriculum  so  that  the  logistics  curriculum 
can  be  evaluated. 

The  last  section  contains  an  open-end  question  that 
allowed  the  respondent  to  comment  on  any  suggestion  he  or 
she  might  have  for  improvement  of  the  logistics  graduate 
education  program.  This  question  was  informally  analyzed 


15 


r 


I 


fi 

> 

-1 


S 


by  the  authors.  Although  not  rigorous  in  nature,  this 
analysis  provided  a measure  of  questionnaire  validity  since 
the  open-end  question  tended  to  reaffirm  findings  based  on 
the  attitudinal  questions  (questions  14-61) . 

The  Measurement  Scale 

Before  the  data  could  be  analyzed,  it  was  necessary 
to  establish  a method  of  quantifying  the  responses.  To  do 
this,  a Likert  seven-point  scale  was  used.  The  scale  con- 
sists of  seven  possible  responses  ranging  from  "strongly 
disagree"  to  "strongly  agree."  This  scale  was  paired  with 
a statement  to  which  the  graduate  was  asked  to  indicate  his 
level  of  agreement  (5:19). 

The  Likert  scale  has  several  advantages.  It  is 
easily  and  quickly  constructed.  Also,  each  item  that  is 
included  has  met  an  empirical  test  for  discriminating  ability. 
Compared  to  the  Thurstone  scale,  another  attitude  scale, 
the  Likert  scale  is  more  reliable  and  provides  a greater 
volume  of  data  (7:250). 

A significant  disadvantage  of  the  Likert  scale  is 
that  it  uses  an  ordinal  level  of  measurement  (7:250). 
Researchers  are  in  general  agreement  that  the  use  of 
parametric  tests  with  ordinal  scales  is  technically  incor- 
rect, but  there  is  little  harm  in  doing  so  (7:115-116). 
Although  some  researchers  maintain  that  data  be  at  least 
interval  level  when  using  parametric  statistics,  there  has 
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been  a shift  in  thought  which  recognizes  the  difficulty  in 
assessing  absolute  levels  of  measure  (8:55).  This  current 
thought  is  summarized  as  (8:55-56): 

1.  The  distinction  between  ordinal  and  interval 
scales  is  not  sharp.  Many  summated  scales  yield  scores 
that,  although  not  strictly  of  interval  strength,  are  only 
mildly  distorted  versions  of  an  interval  scale. 

2.  Some  of  the  arguments  underlying  the  assertion 
that  parametric  procedures  require  interval  strength  statis- 
tics appear  to  be  of  doubtful  validity. 

3.  Parametric  procedures  are,  in  any  case,  robust 
and  yield  valid  conclusions,  even  when  mildly  distorted 
data  are  fed  into  them.  Furthermore,  if  the  distortions 
are  severe,  various  transformation  techniques  can  be  applied 
to  the  data. 

A basic  assumption  in  this  thesis  is  that  the  Likert 
seven-point  scale  be  considered  only  "mildly  distorted" 
interval  level  data.  As  such,  parametric  statistical  tech- 
niques can  be  justifiably  applied. 

Distribution 

In  order  to  reach  the  target  population,  the  AFIT 
Consolidated  Base  Personnel  Office  (CBPO)  provided  a com- 
puter generated  listing  of  active  duty  Air  Force  officers 
who  graduated  from  the  School  of  Systems  and  Logistics' 
Graduate  Management  Program  during  the  period  1963  to  1978. 
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Besides  excluding  those  officers  in  the  process  of  accom- 
plishing a permanent  change  of  station,  five  officers 
assigned  to  Iran  were  excluded  as  well.  The  political  tur- 
moil in  Iran  precluded  mailing  questionnaires  to  these 
graduates . 

Each  of  the  remaining  1045  identified  graduates  was 
sent  a survey  package  that  included  a questionnaire,  com- 
puter answer  sheet,  and  a preaddressed  return  envelope. 
Additionally,  each  survey  package  contained  an  alumni  ros- 
ter information  sheet  used  to  update  locater  information  on 
past  graduates. 

The  questionnaires  were  mailed  on  5 March  1979  with 
a completion  deadline  of  21  March  1979.  A second  mailing 
was  not  attempted. 

Usefulness;  An  Operational  Definition 

Since  the  term  "usefulness"  serves  as  the  foundation 
of  this  thesis  and  is  incorporated  into  the  structure  of 
the  survey,  an  operational  definition  of  the  word  is  neces- 
sary. The  Random  House  Dictionary  of  the  English  Language 
defines  "usefulness"  as  meaning  ".  . .of  practical  use, 
as  for  doing  work;  producing  material  results;  supplying 
common  needs  [21:1574]."  In  the  context  of  our  research, 
an  AFIT  Logistics  education  is  useful  if  it  is  of  perceived 
practical  use  in  the  graduate's  job  performance  (5:13). 

The  term  "usefulness"  was  applied  in  this  manner  with 


regard  to  curriculum,  assignments,  and  promotion  potential. 


1 


"Usefulness"  was  measured  by  the  specific  questions  that 
addressed  these  three  areas. 

Analysis 

As  noted  previously,  the  survey  is  divided  into  four 
areas  of  emphasis:  demographic  (questions  1-13)  , assignment/ 
promotion  (questions  14-21) , education  usefulness/ job 
requirements  (questions  22-61) , and  an  open-end,  free 
response  question  (question  62) . The  first  step  in  our 
analysis  involved  transferring  the  responses  to  these  ques- 
tions from  the  computer  answer  sheet  to  a computer  file. 

This  was  accomplished  by  using  an  optical  scan  device. 
Responses  to  the  open-end  question  were  separated  for  fur- 
ther analysis. 

Validation 

Since  the  questionnaire  had  been  previously  used  and 
subsequently  validated,  this  task  was  not  repeated.  How- 
ever, a brief  description  of  the  validation  process  may  be 
helpful. 

In  their  thesis,  Crowder  and  Davidson  used  factor 
analysis  to  validate  the  questionnaire.  Factor  analysis  is 
a "logical  content  validity  tool  for  attitude  measuring 
instruments  [5:23]."  Since  the  questionnaire  responses  pro- 
vided data  for  attitude  measurement,  factor  analysis  was 
used  to  determine  the  validity  of  grouping  responses  into 
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meaningful  categories.  These  categories  were  then  given 
subjective  labels  and  the  respective  responses  were  aggre- 
gated for  analytical  purposes.  Similarly,  we  have  subjec- 
tively labeled  the  groups  into  various  "usefulness"  cate- 
gories and  indices  as  explained  in  the  following  section. 

Usefulness  Index 

Five  usefulness  categories  were  used  to  develop 
five  corresponding  usefulness  indices  to  evaluate  the 
answers  of  the  respondents.  These  indices,  labeled  Gl, 

G2,  G3,  G4,  and  G5,  are  listed  below  along  with  the  useful- 
ness category  to  which  each  applies. 

1.  Gl — perception  of  enhanced  promotion  potential 
as  a result  of  graduating  from  AFIT  (based  on  questions 
15-18)  . 

2.  G2 — overall  usefulness  of  the  AFIT  Graduate 
Management  Program  as  perceived  by  alumni  (based  on  ques- 
tions 22-25,  59). 

3.  G3 — usefulness  attitudes  of  their  immediate 
supervisors  as  perceived  by  graduates  (based  on  questions 
26-30)  . 

4.  G4 — perceived  curriculum  usefulness  on  the  job 
(based  on  questions  31-56)  . 

5.  G5 — appropriateness  of  assignments  as  perceived 
by  graduates  (based  on  questions  14,  57,  58,  60,  61). 
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Once  the  usefulness  indices  were  computed,  they  were  evalu- 


ated. 


In  order  to  analyze  the  usefulness  indices,  a scale 


was  developed  to  aid  in  answering  the  research  questions. 
Since  the  usefulness  indices  are  based  on  the  seven-point 
Likert  scale,  a similar  scale  was  chosen  for  this  purpose. 
Figure  1 shows  the  scale  upon  which  an  evaluation  of  the 
five  indices  was  based.  As  indicated,  4 was  used  as  the 
separation  point  between  useful  and  not  useful.  Since  a 
descriptor  such  as  a mean  is  continuous,  the  range  4 to  7 
indicates  increasing  perceived  usefulness  and  the  range 
4 to  1 indicates  decreasing  perceived  usefulness  (5:35). 


Not  Useful 


Useful 


Fig.  1.  Usefulness  Indices  Scale 


In  addition  to  determining  the  usefulness  indices 
described,  further  analysis  was  required  in  order  to  meet 


; 


the  last  two  research  objectives.  Rated  officers'  percep- 
tions were  distinguished  from  the  perceptions  of  nonrated 
officers  along  the  lines  of  the  earlier  objectives.  That 
is,  separate  usefulness  indices  were  calculated  for  rated 
officers  and  nonrated  officers.  Then  comparisons  were 
made.  This  same  procedure  was  followed  for  the  last  objec- 
tive, that  of  determining  whether  perceptions  of  usefulness 
differed  between  graduating  classes.  In  this  case, 
separate  G1-G5  indices  were  calculated  for  each  graduating 
year  group  and  comparisons  were  made. 

In  making  these  comparisons,  significant  differ- 
ences were  further  analyzed  in  an  attempt  to  explain  the 
differences.  A criterion  for  determining  what  constituted 
a "significant  difference"  was  subjectively  determined  by 
the  authors  and  is  discussed  further  in  Chapter  III. 

Assumptions  and  Limitations 

The  assumptions  and  limitations  of  this  thesis  are 
based  on  the  concept  that  factors  critical  to  the  con- 
stancy of  the  research  are  assumptions  and  noncritical  fac- 
tors that  limit  the  conclusions  are  limitations  (15:35). 

The  assumptions  made  include  the  following: 

1.  Survey  respondents  take  the  time  to  adequately 
consider  each  response  and  then  answer  honestly. 

2.  The  survey  questionnaire  is  a valid  and  reli- 
able attitude  measurement  tool. 
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3.  The  Likert  seven-point  scale  provides  data 
close  enough  to  interval  level  such  that  a comparison  of 
means  through  the  use  of  parametric  statistics  is  reason- 
able. 

4.  Individual  differences  in  the  perception  of  the 
seven-point  scale  cancel  each  other  out. 

5.  The  operational  definition  of  usefulness  was 
reasonable. 

The  limitations  included: 

1.  Conclusions  applied  only  to  the  respondent 
population.  Since  this  research  was  intended  as  a census 
of  the  1963-1978B  graduates  and  not  all  questionnaires  were 
returned,  no  statistical  inferences  will  be  made  about  the 
overall  population.  This  study  is  descriptive  in  nature 

of  the  population  surveyed. 

2.  Only  limited  accuracy  can  be  achieved  in  the 
measurement  of  attitudes  (5:27-28). 


CHAPTER  III 
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ANALYSIS 


Questionnaire  Response 

As  mentioned  in  Chapter  II,  1045  officers  were 
identified  as  meeting  the  criteria  for  participation  in 
this  survey.  Of  those  identified,  845  returned  survey  ques- 
tionnaires.- Although  three  of  the  questionnaires  were 
incomplete',  they  were  included  in  the  analysis.  The 
responses  examined  accounted  for  80.9  percent  of  those 
mailed.  A more  complete  breakout  of  the  respondents  is 
contained  in  Table  1. 


TABLE  1 

RESPONSE  BREAKOUT  BY  CLASS 


Year  Group 

Returned 

Mailed 

% Returned 

1978 

97 

115 

84.3 

1977 

101 

121 

83.5 

1976 

108 

138 

78.3 

1975 

90 

118 

76.3 

1971-74 

285 

346 

82.4 

1967-70 

152 

188 

80.9 

1963-66 

12 

19 

63.2 

845 

3045 

80.9% 
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An  analysis  based  on  a census  could  not  be  under- 
taken since  the  response  rate  was  less  than  100  percent. 
Therefore,  the  analysis  in  this  chapter  is  meant  to  be  a 
description  of  the  respondent  group  only  and  no  inferences 
to  the  overall  population  are  implied. 

Usefulness  Indices 

The  five  usefulness  indices,  G1  through  G5,  were 
calculated  as  the  distribution  of  summed  responses  as 
described  in  Chapter  II.  These  values  are  presented  in 
Table  2. 


TABLE  2 

USEFULNESS  INDICES 


Index  Mean  Response 


G1 4.423 

G2 5.663 

G3 4.976 

G4 4.420 

G5 3.977 


Significant  Differences 

A subjective  threshold  as  to  what  constituted  a 
significant  difference  was  necessary  in  order  to  meet  the 
last  two  research  objectives.  Since  any  criteria  for  sta- 
tistical significance  would  be  inappropriate,  a criterion 
for  practical  significance  was  in  order  (5:36).  In 
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selecting  this  criterion,  a heuristic  approach  was  followed. 
Guidance  for  selecting  the  subjective  threshold  of  practical 
significance  was  provided  by  Walizer  and  Wienir  in  Research 
Methods  and  Analysis:  Searching  for  Relationships  in  which 
they  suggested  that  "if  there  is  no  change  in  the  distribu- 
tion of  more  than  5 percent  the  distribution  will  be  con- 
sidered identical  [24:103]."  This  subjective  threshold  is 
followed  by  many  researchers  (24:103).  When  applied  to  the 
Likert  Scale  used  in  this  research,  a 5 percent  change 
would  suggest  that  a .35  difference  between  indices  be  con- 
sidered significant.  Taking  a more  conservative  approach, 
for  the  purpose  of  this  research,  any  difference  between 
the  indices  equal  to  or  greater  than  .50  was  considered  to 
be  of  practical  significance  when  comparing  the  different 
subgroups  of  the  respondent  population.  Because  of  the 
subjective  nature  of  this  value.  Appendix  B contains  the 
mean,  median,  mode,  standard  deviation,  and  variance  for 
each  attitudinal  question  so  that  the  reader  may  apply  any 
criteria  he  desires. 

Promotion  Data  Analysis 

The  first  area  of  analysis  involved  an  examination 
of  graduates'  perceptions  concerning  promotion  potential. 
Besides  examining  graduates'  perceptions  in  this  area, 
actual  promotion  rates  were  tabulated. 
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Promotion  Statistics 

Questions  concerning  their  actual  promotion  per- 
formance (questions  19  and  20)  were  asked  of  graduates. 
From  these  responses,  data  were  tabulated  for  promotions 
in  both  the  primary  zone  (first- time  eligibles)  and  in  the 
secondary  zone.  All  promotions  to  the  grades  of  Major, 
Lieutenant  Colonel,  and  Colonel  were  aggregated  for  an 
overall  promotion  rate.  In  deriving  these  rates,  only 
respondents  who  were  eligible  for  promotion  in  either  zone 
were  considered.  It  should  be  noted  that  the  respondents 
are  all  active  duty  officers  and  the  effect  on  the  promo- 
tion rate  of  those  graduates  no  longer  on  active  duty  is 
not  known.  Also,  actual  Air  Force-wide  promotion  statis- 
tics were  gathered  for  the  same  grades  and  were  aggregated 
for  an  overall  promotion  rate  for  comparative  purposes 
(19) . The  data  are  presented  in  Table  4 (primary  zone) 
and  Table  5 (secondary  zone) . 

The  seemingly  high  promotion  rates  achieved  by 
AFIT  graduates  tend  to  confirm  their  perceptions  of 
increased  promotion  chances  as  measured  by  questions  15 
through  18.  It  should  be  noted,  however,  that  the  AFIT 
selection  process  itself  may  identify  officers  with  high 
promotion  potential. 
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TABLE  4 


PRIMARY  ZONE  PROMOTION  STATISTICS  FOR 
MAJOR,  LIEUTENANT  COLONEL,  AND 
COLONEL  COMBINED 


Eligible 

Selected 

% Selected 

AFIT  Gradsa 

506 

455 

89.9% 

Air  Force*5 

9300 

5486 

58.9% 

aBased  on  survey  responses  of  graduates  from  the 
School  of  Systems  and  Logistics  (1963-1978) . 

bBased  on  statistics  from  CY  78  temporary  promotion 
boards  for  first-time  eligibles  to  the  grades  of  Major, 
Lieutenant  Colonel,  and  Colonel. 


TABLE  5 


SECONDARY  ZONE  PROMOTION  STATISTICS  FOR 
MAJOR,  LIEUTENANT  COLONEL,  AND 
COLONEL  COMBINED 


Eligible 

Selected 

% Selected 

AFIT  Gradsa 

739 

65 

8.8% 

Air  Force*5 

21570 

450 

2.1% 

aBased  on  survey  responses  of  graduates  from  the 
School  of  Systems  and  Logistics  (1963-1978)  . 

1bBased  on  statistics  from  CY  78  temporary  promotion 

boards  for  first-time  eligibles  to  the  grades  of  Major, 
Lieutenant  Colonel,  and  Colonel. 
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Overall  Usefulness 


Questions  22  through  25  and  question  59  (refer  to 
Appendix  A)  were  used  to  measure  graduates 1 perceptions 
regarding  the  overall  usefulness  of  the  AFIT  Logistics  Pro- 
gram. Index  G2  was  presented  in  Table  1.  The  mean  response 
to  each  question  in  this  category  is  presented  in  Table  6. 

TABLE  6 

OVERALL  USEFULNESS 

Question  Number  Mean  Response 


22  6.019 

23  5.780 

24a 2.617 

25  5.643 

59  5.490 


aAl though  a negative  response  question,  values  were 
not  reversed  in  this  table.  However,  for  computing  the 
usefulness  index  (G2) , the  mean  was  reversed  for  consist- 
ency (strongly  agree  = 1,  agree  = 2,  etc.). 


Respondents  felt  that  their  AFIT  management  educa- 
tion was  useful  to  the  Air  Force  (question  22)  and  they 
would  encourage  other  qualified  officers  to  attend  the 
school  (question  23) . Also,  graduates  felt  they  were  bet- 
ter equipped  to  solve  on-the-job  problems  as  a result  of 
their  AFIT  education  (questions  25  and  59) . They  disagreed 


that  the  education  was  of  little  use  to  their  on-the-job 
performance  (question  24) . Index  G2  suggests  that, 
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overall,  graduates  perceive  the  school  to  be  useful  to  them- 
selves and  to  the  Air  Force. 


Supervisors'  Perceptions 

Questions  26  through  30  were  used  to  measure  use- 
fulness attitudes  of  their  immediate  supervisors  as  per- 
ceived by  graduates.  These  questions  were  the  basis  for 
index  G3  (refer  to  Table  1) . Again,  the  mean  response 
for  each  question  was  computed  and  is  presented  in  Table  7. 


TABLE  7 

USEFULNESS  ATTITUDES  OF  SUPERVISORS  AS 
PERCEIVED  BY  GRADUATES 


Question  Number 


Mean  Response 


26a 

27 

28 

29 

30 


3.233 

5.136 

4.991 

5.064 

4.920 


aQuestion  26  is  a negative  response  question.  As 
before,  values  were  not  reversed  in  this  table,  but  were 
reversed  when  computing  the  overall  index  (G3) . 


It  should  be  noted  that  questions  26  through  30 
measure  graduates'  perceptions  of  their  supervisors'  feel- 
ings. With  this  in  mind,  graduates'  perceived  their  super- 
visors' attitudes  as  being  favorable  to  the  AFIT  School  of 
Systems  and  Logistics. 
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Comparison 


Indices  G2  and  G3  are  similar  in  that  they  both 
attempt  to  measure  perceptions  related  to  overall  useful- 
ness. However,  while  G2  measures  the  graduates'  percep- 
tions directly,  G3  is  only  an  indirect  measure  of  the 
supervisors*  attitudes.  A comparison  of  these  two  indices 
(G2  = 5.663  versus  G3  = 4.976)  indicates  that  the  graduates 
perceive  their  education  as  being  more  useful  than  they 
(the  graduates)  perceive  their  supervisors  to  perceive  it. 
In  order  to  measure  the  supervisors'  perceptions  directly, 
a separate  survey  of  supervisors  would  be  required  and  is 
beyond  the  scope  of  this  research.  However,  research  in 
this  regard  has  been  accomplished  and  our  findings  are  con- 
sistent with  this  previous  study.  Crowder  and  Davidson 
found  that  there  was  no  significant  difference  between 
supervisors'  perceptions  of  overall  usefulness  and  the  per- 
ceptions of  the  graduates  regarding  overall  usefulness  when 
both  of  these  attitudes  were  measured  directly  (5:56). 

Curriculum  Usefulness 

Questions  31  through  56  measured  the  graduates' 
perceptions  of  the  abilities  required  of  them  in  their  jobs 
These  questions  were  designed  to  correlate  with  various 
subject  areas  in  the  Graduate  Management  Program  offered 
by  the  School  of  Systems  and  Logistics  so  that  a measure 
of  usefulness  of  the  curriculum  could  be  derived  (Index  G4) 


1 

The  authors  subjectively  labeled  each  of  the  26  questions 
in  this  category  with  a brief,  descriptive  course  title. 

The  questions  were  rank  ordered  and  are  included  in  Table  8 
along  with  the  subjective  course  title  and  corresponding 
question  number. 

Assignment  Appropriateness 

Our  fifth  objective  was  to  determine  the  appropriate- 
ness of  follow-on  assignments  as  perceived  by  graduates. 

Questions  14,  57,  58,  60  and  61  were  used  for  that  purpose. 

The  overall  index,  G5 , was  presented  earlier  in  Table  1. 

The  mean  response  to  each  of  these  five  questions  is  pre- 
sented in  Table  9. 

V 

Although  respondents  tended  to  slightly  agree  that 
their  specific  graduate  education  had  been  considered  in 
their  assignments  (question  14) , they  were  basically  unde- 
cided on  whether  their  job  actually  required  an  advanced 
education  (question  57) . While  also  basically  undecided  as 
to  whether  their  job  was  commensurate  with  their  abilities 
(question  58) , they  tended  to  agree  that  they  could  do 
their  job  effectively  without  an  AFIT  education  (question 
60).  Finally,  the  respondents  agreed  that  their  education 
could  be  better  utilized  in  another  duty  assignment  (ques- 
tion 61)  . 

As  another  measure  of  assignment  appropriateness, 
respondents  were  asked  if  their  current  duty  assignment 
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TABLE  8 


CURRICULUM  USEFULNESS 


Course  Description 

Question  # 

Mean  Response 

Speech 

52 

6.468 

Writing 

53 

6.454 

Organizational  Behavior 

51 

5.650 

Analytical  Techniques 

56 

5.334 

Organization  & Mgt. 

38 

5.328 

Financial  Management 

40 

5.052 

Technical  Writing 

33 

4.977 

Mgt.  Information  Systems 

49 

4.833 

Contracting  & Acq.  Mgt. 

37 

4.436 

Environmental  Planning 

47 

4.324 

Quality  Control 

45 

4.319 

Statistics 

39 

4.309 

Basic  Quant.  Methods 

32 

4.241 

Accounting 

31 

4.204 

Quant.  Decision  Making 

34 

4.159 

Contract  Management 

36 

4.088 

Contract  Law 

35 

4.026 

Distribution  Management 

41 

4.005 

Microeconomics 

54 

3.998 

Production  Management 

42 

3.932 

Cost  & Pricing 

46 

3.796 

Simulation 

48 

3.653 

Cost  & Reliability 

55 

3.626 

Macroeconomics 

55 

3.593 

International  Logistics 

43 

3.564 

Computer  Programming 

50 

2.555 

34 
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TABLE  9 

ASSIGNMENT  APPROPRIATENESS 


Question  Number 

Mean  Response 

14  

4.831 

57a 

3.785 

58  

4.219 

60a 

4.492 

61a 

4.887 

aThese  are  negative  response  questions.  Values  in 
the  table  were  not  reversed,  but  were  reversed  when  com- 
puting the  overall  index  (G5) . 

had  an  Advanced  Academic  Degree  Code  (AADC)  requiring  the 
degree  they  had  obtained  from  AFIT.  Of  the  845  respondents, 
only  141  (17  percent)  answered  "yes"  (refer  to  question  10, 
Appendix  A) . Although  130  respondents  (15  percent)  did  not 
know  whether  their  jobs  required  an  AADC,  the  majority 
(574/68  percent)  answered  "no"  to  the  question. 

Since  Index  G5  (assignment  appropriateness)  was  the 
only  index  less  than  4.0,  it  was  singled  out  for  further 
analysis.  Questions  14,  57,  58,  60,  and  61  were  reanalyzed 
based  on  the  graduates'  response  to  question  10 — separate 
G5  indices  were  computed  based  on  whether  the  respondents ' 
job  required  an  AADC.  The  data  is  presented  in  Table  10. 

Table  10  indicates,  without  exception,  that  gradu- 
ates who  hold  a job  requiring  an  AADC  perceive  their 
assignments  to  be  more  appropriate  in  light  of  the 
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TABLE  10 


ASSIGNMENT  APPROPRIATENESS  BASED  ON 
ADVANCED  ACADEMIC  DEGREE  CODE 


Question  Number 

AADC  Required 

AADC  Not  Required 

14 

5.645 

4.551 

57a 

2.957 

4.089 

58 

4.589 

4.026 

60a 

4.170 

4.646 

61a 

4.213 

5.165 

G5  Index 

4.579 

3.725 

aThese  are  negative  response  questions.  Values  in 
the  table  were  not  reversed,  but  were  reversed  when  com- 
puting the  overall  index  for  each  group. 


education  they  have  received.  Moreover,  the  difference 
between  the  G5  indices  for  each  group  is  of  practical  sig- 
nificance as  earlier  defined. 

Since  AADC  was  shown  to  have  a significant  impact 
on  perceptions  of  assignment  appropriateness,  the  authors 
decided  to  undertake  an  analysis  of  curriculum  usefulness 
based  on  AADC  requirements. 

AADC  versus  Curriculum  Usefulness 

Separate  G4  indices  were  calculated  based  on 
graduates'  response  to  question  10.  These  indices,  pre- 
sented in  Table  11,  show  that  a difference  of  practical 


significance  exists  between  graduates  whose  jobs  require 
an  AADC  and  graduates  whose  jobs  do  not  require  an  AADC. 


TABLE  11 


CURRICULUM  USEFULNESS  BASED  ON  AADC  REQUIREMENTS 


AADC  G4  Index 

Required 4.847 

Not  Required 4.236 


Although  both  groups  perceive  the  curriculum  to  be 
useful  in  their  jobs,  graduates  in  jobs  requiring  an  AADC 
perceive  the  curriculum  to  be  significantly  more  useful  than 
those  graduates  in  jobs  not  requiring  an  AADC. 

In  order  to  further  explain  why  graduates  perceived 
their  assignments  to  be  inappropriate,  a further  breakdown 
of  assignment  appropriateness  and  organizational  level  was 
made. 

Assignment  Appropriateness 
and  Organizational  Level 

To  test  the  possibility  that  perceptions  of  assign- 
ment appropriateness  were  related  to  organizational  level  of 
assignment,  separate  G5  indices  were  computed  based  on  gradu- 
ates' responses  to  question  1 (refer  to  Appendix  A).  For 
convenience  of  analysis,  the  levels  of  Air  Division  and 
below  were  combined  and  compared  to  Numbered  Air  Force  and 
above.  Additionally,  responses  marked  "other"  were  excluded 
from  analysis  because  of  the  wide  range  of  responses  in 
this  category.  The  findings  are  presented  in  Table  12. 


TABLE  12 

ASSIGNMENT  APPROPRIATENESS  VERSUS  ORGANIZATIONAL  LEVEL 


Air  Division  & Below  Numbered  Air  Force  & Above 


G5  Index 


3.58 


4.22 


A more  detailed  breakdown  of  the  same  data  is  contained  in 


Appendix  C. 

Based  on  the  data  in  Table  12,  graduates  who  hold 
jobs  at  Numbered  Air  Force  levels  and  above  perceive  their 
assignments  to  be  more  appropriate  than  graduates  assigned 
to  jobs  below  Numbered  Air  Force.  The  overall  significance 
of  this  finding  is  realized  when  the  actual  number  of  gradu- 
ates assigned  to  the  lower  organizational  levels  is  con- 
sidered. Of  the  765  graduates  analyzed,  333  or  43.5  per- 
cent are  assigned  to  Air  Division  and  below  organizational 
levels.  Moreover,  180  of  these  graduates  are  assigned  to 
Squadron  level  jobs — the  level  that  had  the  lowest  G5 
index  (3.41) . 


Rated  versus  Nonrated  Perceptions 
An  analysis  of  the  differences  in  perceptions  of 
rated  and  nonrated  graduates  was  conducted  along  the  lines 
of  earlier  objectives  to  determine  if  differences  of  prac- 
tical significance  existed.  Of  the  845  graduates  who 
responded,  210  were  rated  (127  pilots  and  83  navigators) 
and  635  were  nonrated. 
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First,  a comparison  of  perceptions  regarding 
enhanced  promotion  potential  was  made  (Index  Gl) . Then  com- 


parisons between  the  two  groups  regarding  indices  G2,  G3, 

G4  and  G5  were  conducted. 

Promotion  Potential 

An  analysis  of  any  differences  between  perceptions 
of  rated  and  nonrated  officers  regarding  enhanced  promotion 
potential  simply  entailed  calculating  separate  Gl  indices 
for  each  group.  The  Gl  indices  for  rated  and  nonrated 
graduates  are  presented  in  Table  13. 

TABLE  13 

PERCEPTION  OF  ENHANCED  PROMOTION  POTENTIAL 
BASED  ON  RATED  VERSUS  NONRATED  GRADUATES 


Rated  Graduate?  Gl  Index 


Yes 4.304 

No  4.462 


Table  13  shows  that  no  significant  difference  exists 
between  rated  and  nonrated  graduates — both  groups  tend  to 
agree  that  their  AFIT  education  has  enhanced  their  promotion 
potential. 

Promotion  Statistics 

A comparison  of  the  promotion  rates  of  rated  and 
nonrated  graduates  is  presented  for  descriptive  purposes 
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TABLE  15 


SECONDARY  ZONE  PROMOTION  STATISTICS  FOR 
MAJOR,  LIEUTENANT  COLONEL,  AND 
COLONEL  COMBINED 


Eligible 

Selected 

% Selected 

AFIT  Gradsa 

Rated 

193 

15 

7.8% 

Nonrated 

546 

50 

9.2% 

Air  Force*3 

Rated 

10034 

281 

2.8% 

Nonrated 

9692 

148 

1.5% 

aBased  on  survey  responses  of  graduates  from  the 
School  of  Systems  and  Logistics  (1963-1978) . 

bBased  on  statistics  from  CY  78  temporary  promotion 
boards  for  first-time  eligibles  to  the  grades  of  Major, 
Lieutenant  Colonel,  and  Colonel  (line  officers  only). 


Overall  Usefulness 

Separate  G2  indices  were  computed  for  each  group 
(rated  and  nonrated)  and  comparisons  were  made.  The  data 
is  presented  in  Table  16.  No  significant  difference  exists. 
Both  rated  and  nonrated  alike  agree  concerning  the  overall 
usefulness  of  their  AFIT  graduation. 

Supervisors'  Perceptions 

Separate  G3  indices  were  computed  for  each  group 
in  order  to  compare  their  perceptions  regarding  supervisors' 
attitudes.  The  data  are  presented  in  Table  17.  No  signifi- 
cant difference  exists.  Both  rated  and  nonrated  graduates 


■Z. 
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TABLE  16 


OVERALL  USEFULNESS  BASED  ON  RATED 
VERSUS  NONRATED  GRADUATES 


Group 


G2  Index 


Rated 5.62 

Nonrated 5.73 


TABLE  17 

SUPERVISORS'  ATTITUDES  AS  PERCEIVED  BY 
RATED  AND  NONRATED  GRADUATES 


Group 


G3  Index 


Rated 4.96 

Nonrated 4.98 


percei j a their  supervisor's  attitudes  as  being  favorable 
toward  the  School  of  Systems  and  Logistics. 

Curriculum  Usefulness 

Again,  separate  G4  indices  were  computed  for  rated 
and  nonrated  graduates  in  order  to  compare  their  percep- 
tions regarding  curriculum  usefulness  (questions  31  through 
56).  These  findings  are  presented  in  Table  18. 

Since  a significant  difference  exists,  further 
analysis  was  conducted  to  help  explain  this  difference. 
Because  the  authors  felt  that  assignments  play  an  important 
role  in  a graduates'  perceived  curriculum  usefulness, 
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TABLE  18 


CURRICULUM  USEFULNESS  BASED  ON  RATED 
VERSUS  NONRATED  GRADUATES 


Group 


Rated  . . 
Nonrated 


G4  Index 


further  analysis  was  conducted  in  conjunction  with  rated 
versus  nonrated  assignment  appropriatensss . 

Assignment  Appropriateness 

So  that  the  perceptions  of  rated  and  nonrated 
graduates  could  be  compared  with  regard  to  assignment 
appropriateness,  separate  G5  indices  were  calculated  for 
each  group.  These  indices  are  presented  in  Table  19. 

TABLE  19 

ASSIGNMENT  APPROPRIATENESS  BASED  ON 
RATED  AND  NONRATED  GRADUATES 


Group 

G5  Index 

Rated  

Nonrated  

* 

Since  it  has  already  been  shown  that  assignment 
appropriateness  is  related  to  AADC  requirements  and  the 
organizational  level  in  which  a graduate  works,  these  two 
factors  were  used  in  an  attempt  to  explain  the  difference 
in  perceptions  of  rated  and  nonrated  graduates  regarding 
assignment  appropriateness. 

AADC  Analysis 

In  order  to  explain  part  of  the  difference  in  the 
attitudes  of  rated  and  nonrated  graduates  regarding  assign- 
ment appropriateness,  the  authors  investigated  the  possi- 
bility that  nonrated  graduates  were  being  assigned  to  jobs 
with  an  Advanced  Academic  Degree  Code  more  often  than  rated 
graduates.  Of  the  635  nonrated  graduates  surveyed,  110 
(17.32  percent)  held  jobs  coded  as  requiring  an  advanced 
degree.  However,  of  the  210  rated  graduates  surveyed, 
only  31  (14.76  percent)  had  jobs  coded  for  an  advanced 
degree.  Although  no  statistical  significance  is  implied, 
it  appears  that  nonrated  graduates  are  being  assigned  to 
jobs  requiring  an  advanced  degree  more  often  than  rated 
graduates. 

Organizational  Level  Analysis 

In  an  effort  to  further  explain  the  difference 
between  rated  and  nonrated  indices  of  assignment  appropriate- 
ness, the  differences  in  levels  of  organizational  assign- 
ment were  analyzed.  In  an  earlier  analysis,  it  was  shown 


that  organizational  level  of  assignment  was  related  to  per- 
ceptions of  assignment  appropriateness.  Here,  the  authors 
were  interested  in  determining  if  nonrated  graduates  have 
a higher  incidence  of  assignment  to  higher  organizational 
levels . 

In  making  this  analysis,  the  organizational  levels 
of  Air  Division  and  below  were  again  combined  and  compared 
to  the  levels  of  Numbered  Air  Force  and  above.  "Other" 
responses  were  excluded  from  analysis.  The  data  are  pre- 
sented in  Table  20. 


TABLE  20 

ORGANIZATIONAL  LEVEL  ANALYSIS3— 
RATED  VERSUS  NONRATED 


Air  Division 

Numbered  Air  Force 

& Below 

& Above 

Rated 

125 

69 

Nonrated 

208 

363 

aSixty-four  nonrated  and  sixteen  rated  graduates 
were  assigned  to  "other"  levels  and  were  not  included  in 
this  analysis. 


Of  the  rated  graduates  considered,  64.4  percent 
were  assigned  to  Air  Division  and  below.  This  compares  to 
only  36.4  of  nonrated  graduates  assigned  to  the  same  levels. 
Furthermore,  45.4  percent  (88)  of  the  rated  graduates  were 
assigned  to  squadron  level  jobs,  compared  to  only  16.1 
percent  (92)  of  the  nonrated  graduates.  Again,  although 
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no  statistical  significance  is  implied,  it  appears  that 
rated  graduates  are  assigned  to  lower  organizational  levels 
more  frequently  than  nonrated  graduates. 

Comparison  of  Graduating  Year  Groups 

A comparison  of  the  graduating  year  groups  was  con- 
ducted to  determine  if  there  were  any  differences  in  their 
perceptions  of  usefulness.  Officers  graduating  between  1971 
and  1974,  1967  and  1970,  and  1963  and  1966  were  all  com- 
bined into  separate  groups  for  ease  of  analysis.  This 
analysis  involved  computing  separate  usefulness  indices 
(G1-G5)  for  each  graduating  year  group  and  then  comparing 
these  indices  for  significance. 

Comparisons 

Separate  G1  (Promotion  Enhancement) , G2  (Overall 
Usefulness),  G3  (Supervisors'  Perceptions),  G4  (Curriculum 
Usefulness) , and  G5  (Assignment  Appropriateness)  indices 
were  developed  for  each  graduating  year  group  (refer  to 
question  12,  Appendix  A).  The  results  are  presented  in 
Table  21.  A more  detailed  breakdown  can  be  found  in 
Appendix  E. 

Promotion  Potential — G1 

The  different  year  groups  were  consistent  in  their 
perceptions  regarding  whether  their  AFIT  education  had 
enhanced  their  promotion  chances.  The  only  class  displaying 


TABLE  21 


. 


* 


COMPARISON  OF  GRADUATING  YEAR  GROUPS 


Year  Group 

G1 

G2 

Indices 

G3 

G4 

G5 

1978 

4.59 

5.39 

4.95 

4.31 

3.77 

1977 

4.56 

5.70 

5.21 

4.30 

3.67 

1976 

4.44 

5.70 

5.03 

4.45 

3.94 

1975 

4.34 

5.45 

4.90 

4.38 

3.84 

1971-74 

4.34 

5.65 

4.96 

4.35 

3.93 

1967-70 

4.37 

5.87 

4.84 

4.66 

4.47 

1963-66 

4.94 

6.45 

5.28 

5.12 

4.57 

a significant  difference  of  opinion  compared  to  the  other 
classes  was  the  1963-66  year  group.  Since  the  number  of 
graduates  responding  from  that  year  group  was  low  (12) , and 
no  trend  seemed  apparent,  no  attempt  was  made  to  explain  the 
difference.  The  various  groups  are  consistent  in  that  they 
all  tend  to  slightly  agree  that  their  promotion  chances 
have  increased  as  a result  of  attending  AFIT. 

Overall  Usef ulness--G2 

Again,  the  different  year  groups  were  consistent 
in  their  perceptions  regarding  the  overall  usefulness  of 
the  AFIT  program.  As  before,  the  1963  to  1966  year  group's 
perception  of  the  program's  overall  usefulness  was  higher 
than  any  other  group,  but  no  attempt  was  made  to  explain 

47 


the  difference.  Each  year  group  tended  to  agree  that  the 
program  was  useful  overall. 


I 

: 

■ 


l i 


I 

I 

I 


* 


Supervisors'  Perceptions — G3 

Findings  resulting  from  a comparison  of  the  differ- 
ent year  groups  in  regard  to  perceived  supervisors'  atti- 
tudes are  consistent  with  the  results  presented  earlier  in 
this  study.  First,  graduates,  regardless  of  year  group, 
perceived  their  supervisors'  attitudes  as  being  favorable 
to  the  AFIT  School  of  Systems  and  Logistics.  But  a com- 
parison of  indices  G2  and  G3  shows  that  each  year  group's 
own  perception  of  overall  usefulness  was  higher  than  they 
perceived  their  supervisors'  attitude  toward  overall  use- 
fulness to  be.  In  other  words,  a comparison  of  indices 
G2  and  G3  on  a group-by-group  basis  indicates  that  the 
graduates  perceive  their  education  as  being  more  useful 
than  they  (the  graduates)  perceive  their  supervisors  to 
believe  it  to  be.  As  mentioned  earlier,  previous  research 
showed  that  when  supervisors ' perceptions  were  measured 
directly  and  then  compared  to  graduates'  perceptions,  no 
significant  difference  existed. 

Curriculum  Usefulness — G4 

In  the  area  of  curriculum  usefulness,  as  measured 
by  questions  31-56,  the  different  year  groups  displayed  no 
significant  differences  or  trends,  although  the  1963-66 
year  group  rated  the  curriculum  higher  than  any  other 
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class.  Overall,  each  group  felt  the  curriculum  had  been 
useful  in  their  jobs. 

Assignment  Appropriateness — G5 

In  a comparison  of  perceptions  regarding  assignment 
appropriateness , the  concensus  of  each  of  the  groups  gradu- 
ating between  1971  and  1978  indicated  that  they  considered 
their  assignments  to  be  inappropriate  in  light  of  their 
AFIT  education.  However,  the  groups  graduating  between 
1963  and  1970  considered  their  assignments  to  be  more 
appropriate. 

In  an  attempt  to  possibly  explain  this  difference, 
officers  graduating  from  1971  to  1978  were  combined  to  form 
one  group  and  those  graduating  from  1963  to  1970  were  com- 
bined to  form  a second  group.  A comparison  of  the  two 
resulting  groups  was  made  with  regard  to  jobs  requiring  an 
Advanced  Academic  Degree  Code  and  organizational  level  of 
assignment.  An  analysis  based  on  AADC  did  not  reveal  any 
new  information,  but  a comparison  of  organizational  level 
of  assignment  was  more  enlightening. 

The  organizational  levels  were  grouped  as  before — 
Air  Division  and  below.  Numbered  Air  Force  and  above — and 
a comparison  of  percentages  was  made.  Responses  marked 
"other"  were  excluded  from  analysis.  The  resulting  data 
are  presented  in  Table  22. 
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TABLE  22 
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GRADUATING  YEAR  GROUP  AND  ORGANIZATIONAL 
LEVEL  OF  ASSIGNMENT 


Air  Division 

Numbered  Air  Force 

& Below 

& Above 

1971-78 

47% 

53% 

1963-70 

28% 

72% 

The  significance  of  organizational  level  to  per- 
ceptions of  assignment  appropriateness  was  highlighted 
earlier.  Here  again,  there  appears  to  be  a substantial 
difference  in  assignment  rates  to  Air  Division  & below  for 
the  1971  to  1978  group  when  compared  to  the  1963  to  1970 
group,  which  helps  explain  the  differences  in  their  per- 
ceptions regarding  assignment  appropriateness. 

Analysis  of  Open-end  Question 
Question  62  (refer  to  Appendix  A)  asked  graduates 
to  suggest  improvements  for  the  AFIT  Graduate  Logistics 
Program.  Approximately  25  percent  of  tie  surveys  returned 
contained  a response  to  this  question.  These  responses 
were  analyzed  to  determine  if  the  suggestions  were  con- 
centrated in  any  particular  areas  and  to  get  an  overall 
idea  of  the  graduates’  feelings  regarding  the  school.  In 
doing  this,  it  was  found  that  the  suggestions  fell  into 
four  basic  categories  relating  to  assignments,  speaking 
and  writing,  school  publicity,  and  course  additions/ 
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deletions.  These  four  categories  are  presented  below  along 
with  representative  comments  from  the  graduates. 
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Assignments 

The  most  prevalent  suggestions  dealt  with  assign- 
ments. Graduates  expressed  feelings  of  general  dissatis- 
faction with  their  jobs.  They  felt  that  they  could  be  more 
effectively  utilized  in  assignments  that  required  their 
education.  Overall,  the  suggestions  indicated  that  the  Air 
Force  was  not  effectively  matching  graduates  to  jobs  that 
fully  utilized  their  abilities. 

One  example  of  this  situation  resulted  in  the  fol- 
lowing comment — "The  Air  Force  does  not  use  the  education 
it  has  financed  for  me.  Civilian  industry  will.  My  resig- 
nation is  effective  1 May  1979."  Another  respondent  sug- 
gested that  "Major  Commands  should  monitor  and  control 
people  who  have  advanced  academic  degrees  to  insure  they 
are  utilized  properly."  Regarding  the  use  of  his  graduate 
logistics  education  in  three  follow-on  jobs,  a respondent 
wrote,  "I  have  worked  in  a joint  service  SPO  (4  years) , 
at  wing  maintenance  (3  years) , and  now  at  AFTEC.  My  AFIT 
education  has  been  of  little  use  in  all  3 jobs." 

These  comments  support  earlier  findings  in  this 
research  as  expressed  by  index  G5 — assignment  appropriate- 
ness. That  is,  graduates  feel  their  assignments  to  be 
inappropriate  in  light  of  the  education  they  have  received. 
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Speaking  and  Writing 

A second  area  of  concentration  was  concerned  with 
speaking  and  writing  skills.  Graduates  tended  to  empha- 
size the  importance  of  these  basic  skills  in  the  day-to- 
day  performance  of  their  jobs.  They  suggested  that  speak- 
ing and  writing  be  emphasized  in  the  program.  One  respon- 
dent wrote  "encourage  the  use  of  term  papers  and  speeches. 

I have  found  that  it's  vitally  important  to  speak  and  write 
clearly  and  concisely."  Another  suggested  that  "more  time 
and  effort  should  be  devoted  to  developing  communication 
skills  . . . ." 

Again,  their  suggestions  are  consistent  with 
earlier  findings.  In  an  analysis  of  curriculum  usefulness, 
speaking  and  writing  rated  as  the  two  most  frequently  cited 
abilities  required  on  the  job. 

School  Publicity 

Another  area  where  suggestions  were  concentrated 
concerned  the  need  to  publicize  the  school.  Graduates 
felt  that  their  supervisors  and  others  were  not  aware  of 
the  capabilities  graduates  had  acquired  from  AFIT.  Gradu- 
ates felt  that  supervisors  should  be  made  more  aware  of 
what  the  graduate  is  capable  of  doing.  When  commenting  on 
the  decision  making  techniques  he  had  learned  at  AFIT,  one 
graduate  stated  that 
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...  a lack  of  understanding  of  the  techniques  by 
superiors,  peers,  and  subordinates  make  it  difficult 
to  use  these  techniques  as  aids  to  decision  making  when 
so  many  people  still  believe  completely  in  the  "seat 
of  the  pants"  approach  to  decision  making. 

Another  graduate  stated  that  his  supervisors  are  "unfamiliar 

with  the  terminology,  analytical  tools,  and  subjects  taught 

at  AFIT."  A recent  graduate  stated  that 

My  civilian  supervisor  knows  too  little  about  the 
Logistics  program.  ...  I suggest  you  prepare  a 
package  for  the  supervisors  of  graduates  which  would 
explain  the  program  and  summarize  the  curriculum. 

Course  Changes 

Graduates  recommended  numerous  course  additions 
and  deletions.  Since  the  majority  of  responses  in  this 
category  did  not  concern  any  one  course  or  subject  area, 
this  information  was  presented  to  the  applicable  depart- 
ments (i.e..  Department  of  Communication  and  Humanities) 
for  consideration. 

Thus,  with  the  analysis  of  the  graduates'  responses 
to  the  survey  complete,  effort  was  directed  toward  trans- 
lating these  findings  into  useful  conclusions. 
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CHAPTER  IV 


CONCLUSIONS  AND  RECOMMENDATIONS 

Summary 

This  study  was  undertaken  to  determine  the  useful- 
ness of  the  graduate  degree  earned  at  the  AFIT  School  of 
Systems  and  Logistics.  Such  an  evaluation  is  continually 
needed  because  of  changing  technology  and  subsequent 
changing  job  requirements.  Also,  government  budgetary 
restraints  have  resulted  in  numerous  Congressional  attacks 
on  DOD  and  Air  Force  sponsored  graduate  education  programs. 
Such  close  scrutiny  further  warrants  studies  to  justify 
expenditures.  Having  thus  established  the  problem  and 
justified  the  research,  objectives  to  be  met  were  estab- 
lished . 

The  main  objective  was  to  determine  the  extent  to 
which  the  graduates  had  used  their  AFIT  education  in 
follow-on  assignments.  In  doing  this,  the  authors  wanted 
to  determine  graduates'  perceptions  in  several  different 
areas.  First,  did  graduates  perceive  their  promotion 
chances  to  increase  because  of  their  graduate  education? 
Next,  what  were  their  perceptions  of  the  overall  usefulness 
of  the  program?  How  did  graduates  perceive  their  super- 
visors' feelings  as  to  the  usefulness  of  the  program?  Also, 


how  useful  did  graduates  perceive  the  curriculum  to  be 
in  their  jobs?  Did  graduates  feel  their  follow-on  assign- 
ments to  be  appropriate  considering  the  education  they  had 
received?  Was  there  a difference  in  the  perceptions  of 
rated  and  nonrated  graduates  regarding  the  AFIT  program? 
Finally,  were  there  any  differences  in  the  perceptions  of 
usefulness  among  graduates  of  different  time  periods?  After 
establishing  these  objectives,  the  procedure  for  meeting 
them  was  developed. 

Graduates  dating  back  to  the  first  class  awarded 
a Master  of  Science  degree  in  1963,  to  the  most  recent 
graduating  class,  197 8B,  were  identified  for  analysis.  Air 
Force  officers  still  on  active  duty  and  not  in  the  process 
of  making  a permanent  change  of  station  were  sent  previously 
developed  questionnaires.  Of  the  1045  questionnaires 
mailed,  845  completed  surveys  were  returned--a  rate  of 
80.9  percent. 

Five  "usefulness"  categories  were  developed  and  sub- 
jectively labeled  to  coincide  with  the  first  five  research 
objectives.  Corresponding  indices  (G1  to  G5)  were  computed 
from  the  graduates'  responses  to  questions  belonging  to  one 
of  the  five  categories.  Next,  separate  G1  to  G5  indices 
were  computed  for  the  different  subgroups  of  graduates. 

These  were  used  as  the  basis  for  meeting  the  last  two 
research  objectives — the  comparison  of  rated  and  nonrated 
graduates  and  comparison  of  graduates  of  different  classes. 
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In  making  these  comparisons,  any  difference  between  the 
indices  of  .5  or  greater  was  considered  to  be  of  prac- 
tical significance.  When  a practically  significant  differ- 
ence was  found  to  exist,  further  analysis  was  conducted  in 
order  to  help  explain  the  difference.  All  of  these  pro- 
cedures were  employed  with  the  objective  of  providing  a 
descriptive  analysis  of  the  respondent  group.  No  inference 
to  the  overall  population  was  made  or  implied. 

Conclusions 

The  conclusions  of  this  research  are  based  on  an 
analysis  of  the  responses  to  a survey  of  845  active  duty 
Air  Force  officers  who  graduated  from  the  AFIT  School  of 
Systems  and  Logistics  between  1963  and  1978.  Limitations 
on  the  conclusions  are: 

1.  The  conclusions  apply  only  to  the  respondent 
population.  Since  the  research  was  originally  intended  as 
a census  and  not  all  questionnaires  were  returned,  no  sta- 
tistical inferences  to  the  overall  population  were 
attempted.  This  study  is  descriptive  of  the  respondent 
population  only. 

2.  Only  limited  accuracy  can  be  achieved  in  the 
measurement  of  attitudes. 

Analysis  of  questionnaires  completed  by  the  respon- 
dent population  led  to  the  following  conclusions: 


1.  Graduates  felt  their  promotion  chances  had 


increased  as  a result  of  attending  AFIT.  This  conclusion 
is  based  on  a G1  index  of  4.423.  Graduates'  perceptions 
in  this  regard  are  supported  by  the  high  promotion  rates 
achieved  by  them  in  both  primary  and  secondary  promotion 
zones . 

2.  Graduates  felt  that  the  AFIT  Graduate  Logis- 
tics Program  was  useful  overall  to  themselves  and  to  the 
Air  Force.  This  conclusion  is  based  on  a G2  index  of 
5.663. 

3.  Graduates  perceived  their  supervisors'  feelings 
to  be  favorable  to  the  AFIT  program.  This  conclusion  is 
based  on  a G3  index  of  4.976.  However,  graduates  perceive 
the  school  to  be  more  useful  than  they  (the  graduates) 
perceive  their  supervisors  to  believe  it  to  be.  This  con- 
clusion is  based  on  a comparison  of  indices  G2  and  G3-- 
5.663  versus  4.976.  No  possible  explanation  of  this  dif- 
ference was  found  and  is  believed  to  be  beyond  the  scope 

of  this  research. 

4.  Overall,  graduates  felt  that  courses  offered 

at  the  School  of  Systems  and  Logistics  were  useful  in  their 
jobs.  This  conclusion  is  based  on  a G4  index  of  4.420. 

5.  Overall,  graduates  felt  their  assignments  to 
be  inappropriate  in  light  of  the  education  they  had 
received.  This  conclusion  is  supported  by  a G5  index  of 
only  3.977.  Also,  the  authors  concluded: 
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(a)  Graduates  in  jobs  requiring  an  Advanced 
Academic  Degree  Code  (AADC)  perceived  their  assignments 

to  be  more  appropriate  than  graduates  in  jobs  not  requiring 
an  AADC.  This  conclusion  is  supported  by  a comparison  of 
G5  indices  for  each  of  the  two  groups — 4.579  (AADC  required) 
versus  3.735  (AADC  not  required). 

(b)  Graduates  assigned  to  jobs  in  lower  organi- 
zational levels  (Air  Division  and  below)  perceived  their 
assignments  to  be  less  appropriate  than  graduates  assigned 
to  higher  organizational  levels  (Numbered  Air  Force  and 
above) . This  conclusion  is  supported  by  a comparison  of 

G5  indices  calculated  based  on  responses  to  question  1 
(refer  to  Appendix  A) — 3.48  (Air  Division  and  below)  versus 
4.22  (Numbered  Air  Force  and  above). 

The  conclusions  from  5(a)  and  5(b)  above  were  used  as  the 
basis  for  explaining  conclusion  5.  That  is,  only  16.7 
percent  of  the  graduates  surveyed  were  assigned  to  jobs 
requiring  an  Advanced  Academic  Degree  Code.  Also,  a rela- 
tively high  percentage  of  graduates  were  assigned  to  the 
lower  organizational  levels  described  above.  Approximately 
43.5  percent  of  the  graduates  surveyed  were  assigned  to  jobs 
at  or  ’ elow  the  Air  Division  level. 

6.  No  significant  difference  was  found  to  exist 
between  rated  and  nonrated  graduates  regarding  their  per- 
ceptions of  promotion  potential,  overall  usefulness,  or 


perceived  supervisors'  perceptions.  This  conclusion  was 
based  on  a comparison  of  Gl,  G2,  and  G3  indices  for  both 
groups.  However,  nonrated  graduates  felt  the  curriculum 
to  be  more  useful  than  did  rated  graduates.  G4  indices  for 
rated  and  nonrated  graduates  were  3.98  and  4.56  respec- 
tively. Also,  nonrated  graduates  considered  their  assign- 
ments to  be  more  appropriate  than  did  rated  graduates . 

This  conclusion  was  based  on  a comparison  of  G5  indices  of 
3.601  and  4.102  for  rated  and  nonrated  graduates  respec- 
tively. Using  the  findings  from  5(a)  and  5(b)  above,  these 
last  two  conclusions  were  partially  explained  by: 

(a)  Nonrated  graduates  are  assigned  to 
Advanced  Academic  Degree  Coded  jobs  more  frequently  than 
rated  graduates — 17.32  percent  versus  14.76  percent. 

(b)  Nonrated  graduates  are  assigned  to  lower 
organizational  levels  less  frequently  than  rated  graduates — 
36.4  percent  versus  64.4  percent. 

7.  No  significant  differences  were  found  to  exist 
between  graduates  of  different  time  periods  regarding  per- 
ceived promotion  potential,  overall  usefulness,  super- 
visors' perceptions,  or  curriculum  usefulness.  This  con- 
clusion was  based  on  a comparison  of  indices  Gl,  G2,  G3 , 
and  G4  for  the  respective  groups.  However,  those  officers 
graduating  between  1971  and  1978  felt  their  assignments 
to  be  less  appropriate  than  did  the  graduates  of  the  1963 
to  1970  year  group.  This  conclusion  was  based  on  a 
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comparison  of  G5  indices  for  each  of  the  two  groups.  Again, 
the  findings  presented  in  5(b)  were  used  as  the  basis  for 
explaining  the  difference.  Graduates  from  the  1963  to  1970 
group  were  assigned  to  lower  organizational  levels  less 
frequently  than  graduates  from  the  1971  to  1978  group — 28 
percent  versus  47  percent  respectively. 

Recommendations 

Based  on  our  analysis  and  subsequent  conclusions, 
several  recommendations  are  in  order. 

1.  Improve  the  quality  of  assignments.  AFIT 
graduates  should  be  assigned  to  jobs  that  effectively 
utilize  their  graduate  education.  The  Advanced  Academic 
Degree  Code  provides  a good  measure  of  assignment  appropri- 
ateness. Therefore,  it  is  recommended  that  students  not 

be  assigned  to  AFIT  unless  the  Manpower  and  Personnel 
Center  (MPC)  can  assure  them  Advanced  Academic  Degree  Coded 
jobs  upon  graduation. 

2.  Assign  graduates  to  higher  organizational 
levels.  There  is  a disproportionate  share  of  graduates 
assigned  to  lower  organizational  levels,  particularly  to 
squadron  and  below  assignments — the  level  that  showed  the 
least  use  of  the  graduates'  education.  Since  higher 
organizational  levels  make  better  use  of  the  graduates' 
education,  MPC  should  assign  graduates  to  these  higher 
levels . 


60 


3.  Utilize  rated  graduates  more  effectively. 

Rated  graduates'  assignments  are  the  least  appropriate, 
more  likely  to  be  at  lower  organizational  levels,  and 
require  an  advanced  degree  less  often  than  other  graduates. 
Rated  graduates  should  be  used  at  least  as  effectively  as 
nonrated  graduates.  It  is  recommended  that  MPC  and  Major 
Commands  monitor  rated  graduates'  assignments  following 
directed  flying  duty  in  order  to  assign  them  to  jobs  that 
effectively  utilize  their  graduate  education. 

4.  Acquaint  supervisors  in  the  field  with  the  AFIT 
program.  Supervisors  are  generally  not  aware  of  the  educa- 
tional opportunities  that  have  been  made  available  to  AFIT 
graduates.  As  a result,  it  seems  they  are  not  effectively 
utilizing  the  graduates'  skills.  The  School  of  Systems  and 
Logistics  should  inform  supervisors  about  the  job  graduates 
are  capable  of  performing — given  the  chance.  Without  the 
opportunity  to  apply  his  knowledge  on  the  job,  an  officer's 
AFIT  graduate  education  is  a waste  of  time  and  money  to  the 
Air  Force. 

Recommendations  for  Future  Research 

To  aid  future  researchers,  the  raw  data  used  in 
this  research  is  available  from  the  Department  of  Communica- 
tion and  Humanities,  School  of  Systems  and  Logistics, 
Wright-Patterson  AFB,  Ohio.  With  this  data  thus  available, 
additional  research  is  recommended  with  regard  to: 


1.  Assignments — analyze  Air  Force  Specialty  Codes 
addressed  in  the  questionnaire  in  an  effort  to  identify 
which  particular  jobs  most  effectively  utilize  a graduate's 
advanced  education. 

2.  Sampling  techniques — develop  a sampling  plan 
whereby  statistical  inferences  from  the  sample  can  be 
applied  to  the  general  population  of  AFIT  graduates. 

3.  Comparing  current  students  and  graduates — make 
the  necessary  modifications  to  the  questionnaire  used  in 
this  research  and  then  survey  officers  currently  attending 
the  School  of  Systems  and  Logistics.  Compare  the  students' 
anticipations  with  the  perceptions  of  graduates  in  the 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  FORCE  INSTITUTE  OF  TECHNOLOGY  (ATC) 
WRIGHT.PATTERSON  AIR  FORCE  BASE.  OHIO  4S433 

LSGR  (Lt  Col  McKemey/AUTOVON  785-4698)  28  February  1979 

AFIT  Graduate  Management  Programs  Alumni  Survey 


School  of  Systems  and  Logistics  Alumnus 


1.  The  AFIT  School  of  Systems  and  Logistics  is  constantly  striving  to 
make  the  graduate  management  curriculum  relevant  to  the  on-the-job 
needs  of  the  Air  Force.  The  attached  questionnaire  is  Intended  to 
determine  how. graduates  feel  about  the  usefulness  of  the  program  to 
themselves  and  to  the  Air  Force.  The  survey  has  been  reviewed  and 
approved  by  HQ  USAF  and  has  been  designated  USAF  SCN  79-56. 

2.  While  your  participation  in  this  survey  is  voluntary,  a valid  cross 
section  of  attitudes  is  possible  only  through  your  willingness  to  take 
15-20  minutes  to  complete  and  return  the  survey.  Your  responses  to  the 
questions  will  he  confidential;  we  are  interested  in  the  collective 
responses  of  graduates. 


3.  Please  return  the  completed  survey  in  the  enclosed  preaddressed 
envelope  hy  20  March  1979. 


Major  General,  USAF 
Commandant 


3 Atch 

1.  Survey 

2.  Answer  Sheet 

3.  Return  Envelope 
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Strength  Through  Knowledge 


PRIVACY  ACT  STATEMENT 


i : 

I 

In  accordance  with  paragraph  30,  AFR  12-35,  the 
following  information  is  provided  as  required  by  the 
Privacy  Act  of  1974. 

[1 

a.  Authority 

(1)  10  USC  8012,  Secretary  of  the  Air  Force, 
Powers,  Duties,  Delegation  by  Compensation;  and/ or 

(2)  5 USC  301,  Departmental  Regulations; 

and/or 

(3)  DOD  Instruction  1100.13,  17  Apr  68, 

Surveys  of  Department  of  Defense  Personnel;  and/or 

(4)  AFR  30-23,  22  Sep  76,  Air  Force  Personnel 
Survey  Programs; 

b.  Principal  purposes.  The  survey  is  being  con- 
ducted to  collect  information  to  be  used  in  research  aimed 
at  illuminating  and  providing  inputs  to  the  solution  of 
problems  of  interest  to  the  Air  Force  and/or  DOD. 

c.  Routine  uses.  The  survey  data  will  be  converted 
to  information  for  use  in  research  and  management  related 
problems.  Results  of  the  research,  based  on  the  data  pro- 
vided, will  be  included  in  a written  doctoral  dissertation 
and/or  master's  theses,  and  may  also  be  included  in  pub- 
lished articles,  reports,  or  texts.  Distribution  of  the 
results  of  the  research  based  on  the  survey  data,  whether 
in  written  form  or  presented  orally,  will  be  unlimited. 

d.  Participation  in  this  survey  is  entirely 
voluntary. 

e.  No  adverse  action  of  any  kind  may  be  taken 
against  any  individual  who  elects  not  to  participate  in  any 
part  or  all  of  this  survey. 
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1979  GRADUATE  SURVEY 


GRADUATE  MANAGEMENT  PROGRAMS 


Please  mark  your  responses  to  the  following  questions  on  the 
machine  scorable  answer  sheet  with  a Number  2 pencil. 


PART  I— BACKGROUND  INFORMATION 

1.  What  is  the  organizational  level  of  your  current  assignment? 

a.  Squadron  or  below 

b . Group 

c.  Wing 

d.  Air  Division 

e.  Numbered  Air  Force 

f.  Major  Command 

g.  HQ  Air  Force 

h.  Department  of  Defense 

i.  Separate  Operating  Agency 

j.  Other  (please  describe)  

k.  Not  applicable 

2.  To  what  Major  Command  are  you  presently  assigned? 


a. 

SAC 

h. 

USAFA 

O. 

AFC 

b. 

TAC 

i. 

USAFE 

P- 

AFLC 

c. 

MAC 

j. 

USAF SO 

q- 

AFSC 

d. 

ATC 

k. 

USAFSS 

r. 

Other  (please  describe) 

e. 

USAF 

1. 

AAC 

f. 

HQ  USAF 

m. 

ADC 

s. 

Not  applicable 

g- 

PACAF 

n. 

AFAFC 

What  is  your 

current 

duty  AFSC? 

a. 

28XX 

h. 

62XX 

o. 

27XX 

b. 

30XX 

i. 

63XX 

P- 

29XX 

c. 

31XX 

j- 

64XX 

q- 

55XX 

d. 

40XX 

k. 

65XX 

r. 

Other  (please  describe) 

e. 

46XX 

1. 

66XX 

f. 

51XX 

m. 

67XX 

s. 

Civilian/Not  applicable 

g* 

60XX 

n. 

004X 

SCN : 79-36  (Expires  30  Apr  79) 
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4.  How  long  have  you  held  your  present  assignment? 

a.  1 year  or  less 

b.  Over  1 year  but  less  than  2 years 

c.  2 years  but  less  than  3 years 

d.  3 years  or  over 

5.  What  was  your  grade  when  you  finished  your  resident  AFIT  program? 

a.  0-1 

b.  0-2 

c.  0-3 

d.  0-4 

e.  0-5 

f.  0-6 

g.  Civilian  (please  write  in  GS  grade)  

6.  What  is  your  current  grade? 

a.  0-1 

b.  0-2 

c.  0-3 

d.  0-4 

e.  0-5 

f.  0-6 

g.  Civilian  (please  write  in  GS  grade)  

7.  How  many  people  do  you  directly  supervise? 

a.  0-2  people 

b.  3-6  people 

c.  7-10  people 

. d.  11-15  people 

e.  over  15  people 

8.  How  many  years  commissioned  service  do  you  have? 

a.  5 years  or  less 

b.  over  5 years  but  less  than  10  years 

c.  over  10  years  but  less  than  15  years 

d.  over  15  years  but  less  than  20  years 

e.  over  20  years 

f.  Civilian 
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10. 


11. 


1 


9.  What  is  your  aeronautical  rating? 


a.  Pilot 

b.  Navigator 

c.  Nonrated 

d.  Not  applicable 


Does  your  current  duty  assignment  have  an  Advanced  Academic 
Degree  code  requiring  the  specific  master's  degree  you  acquired 
from  the  Air  Force  Institute  of  Technology? 


a.  Yes 

b.  No 

c.  I don't  know 

d.  Not  applicable 


What  approximate  percentage  of  time  have  you  served  in  a logis- 
tics related  job  (including  Facilities  Management)  since  gradua- 
tion? 


a. 

b. 

c. 

d. 

e. 


0-10% 

11-25% 

26-50% 

51-75% 

76-100% 


12.  When  did  you  complete  your  full-time  resident  studies  at  AFIT? 


a. 

in 

1978 

b. 

in 

1977 

c. 

in 

1976 

d. 

in 

1975 

e. 

in 

1971, 

1972,  1973,  or 

f. 

in 

1967, 

1968,  1969,  or 

9- 

in 

1966 

or  prior  to  1966 

13.  What  was  your  specific  graduate  program? 


a. 

b. 

c. 

d. 

e. 

f . 


Logistics  Management 

Logistics  Management  (Procurement  Major) 

Logistics  Management  (International  Logistics  Major) 
Logistics  Management  (Acquisition  Logistics  Major) 
Facilities  Management 
Other 
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PART  II— ASSIGNMENT/PROMOTION  INFORMATION 

The  questions  in  this  section  are  intended  to  provide  informa- 
tion about  the  assignments/promotability  of  Air  Force  Institute  of 
Technology  graduates  as  a group  compared  to  all  Air  Force  officers. 
Please  indicate  how  much  you  agree  or  disagree  with  the  following 
statements  using  this  response  scale: 


Strongly  Slightly 

Disagree  Disagree  Disagree 


i i i 

ABC 


Neither 

Agree  nor  Slightly 


Disagree 


Agree 


Agree 


Strongly 

Agree 


14.  My  specific  graduate  education  has  been  considered  in  my  assign- 
ment (s)  since  graduation. 

15.  My  graduate  education  has  enabled  me  to  assume  broader  responsi- 
bilities than  my  contemporaries  without  an  AFIT  education. 

16.  My  graduate  education  has  enhanced  my  promotion  chances  compared 
to  my  contemporaries  without  an  AFIT  education. 

17.  My  AFIT  graduate  degree  has  more  weight  for  promotion  than  a 
degree  earned  through  off-duty  education. 

18.  My  AFIT  resident  programs  degree  has  more  weight  for  promotion 
them  a degree  earned  through  the  AFIT  Civilian  Institutions 
degree  program. 

19.  I was  selected  for  promotion  in  the  secondary  zone  to  the  grade (s) 
of: 

a.  Major 

b.  Lieutenant  Colonel 

c.  Colonel 

d.  To  a.  and  b. 

e.  To  a.  and  c. 

f.  To  b.  and  c. 

g.  To  a. , b. , and  c. 

h.  Not  selected  for  any  secondary  zone  promotions  when  eligible 

i.  Have  not  been  eligible  for  secondary  zone  consideration 
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Please  use  the  following  responses: 


Strongly 

Disagree 

Neither 

Slightly  Agree  nor  Slightly 

Disagree  Disagree  Disagree  Agree 

Strongly 

Agree  Agree 

1 1 

I 

A 

I I 1 1 

B C D E 

1 1 

F G 

20.  I was  selected  for  promotion  in  the  primary  zone 

the  first  time 

I was  eligible  to  the  grade  of: 

a. 

Major 

b. 

Lieutenant  Colonel 

c. 

Colonel 

d. 

a.  and  b. 

e. 

a . and  c . 

f. 

b . and  c . 

9- 

a . , b. , and  c . 

h. 

Not  applicable — I have  not  been  eligible  yet 
consideration  to  any  grade 

for  primary  zone 

i. 

I have  been  passed  over  for  promotion 

21.  I was  passed  over  for  promotion  in  the  primary  zone  one  or  more 
times : 

a.  To  Major 

b.  To  Lieutenant  Colonel 

c.  Both  a.  and  b. 

d.  Not  applicable — I was  selected  for  promotion  when  eligible 


PART  III— EDUCATION  USEFULNESS/JOB  REQUIREMENTS  INFORMATION 

The  questions  in  this  section  are  concerned  with  the  useful- 
ness/appropriateness of  the  AFIT  School  of  Systems  and  Logistics 
graduate  management  programs  and  the  requirements  of  your  present  job. 
Read  each  statement,  then  mark  the  answer  sheet  to  indicate  how  much 
you  agree  or  disagree  with  the  statement.  Use  the  following  response 
scale  for  each  question: 

Neither 

Strongly  Slightly  Agree  nor  Slightly  Strongly 

Disagree  Disagree  Disagree  Disagree  Agree  Agree  Agree 

— I I t — F 1 1 H 

A B C D E F G 

22.  My  AFIT  School  of  Systems  and  Logistics  management  education  is 
useful  to  the  Air  Force. 
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Please  use  the  following  responses : 


Strongly 

Agree 


Disagree 


Neither 

Slightly  Agree  nor  Slightly 
Disagree  Disagree  Agree 


Strongly 
Agree  Agree 


*1 

i 


23.  I would  encourage  other  qualified  officers  to  attend  the  AFIT 
School  of  Systems  and  Logistics  graduate  management  program. 

24.  My  AFIT  School  of  Systems  and  Logistics  education  is  of  little 
use  to  my  on-the-job  performance. 


25.  I am  better  equipped  to  solve  on-the-job  problems  because  of  my 
AFIT  School  of  Systems  and  Logistics  education. 

Please  do  not  consult  with  your  supervisor  when  answering 

questions  26-30.  We  need  your  impression  of  the  supervisor's  views. 

26.  My  supervisor  feels  that  an  AFIT  School  of  Systems  and  Logistics 
education  is  of  little  use  to  my  on-the-job  performance. 

27.  My  supervisor  feels  that  my  AFIT  School  of  Systems  and  Logistics 
education  is  useful  to  the  Air  Force. 

28.  My  supervisor  would  encourage  other  people  who  work  for  him  or 
her  to  attend  the  AFIT  School  of  Systems  and  Logistics  graduate 
management  program. 

29.  My  supervisor  feels  that  attendance  of  the  AFIT  School  of  Systems 
and  Logistics  graduate  management  program  has  enhanced  my  Air 
Force  career. 

30.  My  supervisor  feels  that  I am  better  equipped  to  solve  on-the-job 
problems  because  of  my  AFIT  School  of  Systems  and  Logistics  educa- 
tion. 

31.  My  job  requires  the  ability  to  understand  and  analyze  accounting 
records  and  reports  (such  as  fund  coding  system,  budgets,  cost 
center  reports,  allotment  ledgers,  financial  statement,  etc.). 

32.  My  job  requires  the  ability  to  understand  and/or  apply  mathemati- 
cal techniques  beyond  basic  arithmetic  operations. 

33.  My  job  requires  the  ability  to  understand  and  analyze  or  actually 
prepare  in-depth  staff  studies,  technical  reports,  research 
studies,  etc. 
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Please  use  the  following  responses: 


Strongly  Slightly 

Disagree  Disagree  Disagree 


Neither 
Agree  nor 
Disagree 


Slightly 

Agree 


Strongly 
Agree  Agree 


34. 

My  job  requires  the  ability  to  use  and/or  understand  quantitative 
decision  making  techniques  such  as  best  order  quantity,  transpora 
tion  routes  with  the  lowest  cost,  most  efficient  use  of  available 
personnel,  etc. 

35. 

My  job  requires  a working  knowledge  of  those  federal  laws  appli- 
cable in  the  letting  and  administration  of  contracts  (such  as 
laws /regulations  concerning  competitive  bidding,  use  of  accepted 
specifications,  etc.). 

36. 

My  job  requires  a working  knowledge  of  the  contract  administra- 
tion process. 

37. 

My  job  requires  a working  knowledge  of  the  federal  procurement 
and/or  acquisition  process. 

38. 

My  job  requires  the  ability  to  analyze  existing  organizational 
structure  (such  as  work  flow  patterns,  interpersonal  communica- 
tions, etc.). 

39. 

My  job  requires  the  understanding  and/or  application  of  statisti- 
cal analysis  concepts  (such  as  in  requirements  forecasting, 
analysis  of  trends,  predicting  the  probability  of  an  occurrence, 
etc. ) . 

40. 

My  job  requires  an  understanding  of  the  financial  management 
methods  and  systems  used  by  the  DOD  (such  as  the  Resource  Manage- 
ment System,  Programming,  Planning  and  Budgeting  System,  indus- 
trial funds,  stock  funds,  etc.). 

41. 

My  job  requires  the  ability  to  manage  the  various  elements  of 
distribution  systems  such  as  base  supply  systems , transportation 
methods,  order  processing,  inventory  control,  etc. 

42. 

My  job  requires  the  ability  to  manage  or  control  maintenance  and/ 
or  production  processes  (such  as  scheduling,  component  assembly, 
repair,  etc.). 
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Please  use  the  following  responses: 


Neither 

Strongly  Slightly  Agree  nor  Slightly  Strongly 

Disagree  Disagree  Disagree  Disagree  Agree  Agree  Agree 


43.  My  job  requires  a knowledge  of  DOD  involvement  in  international 
military  systems  programs  such  as  the  Grant  Aid  Program,  Foreign 
Military  Sales  Program,  international  supply  support  arrangements, 
foreign  military  training,  etc. 

44.  My  job  requires  the  ability  to  determine  and/or  evaluate  the 
impact  of  reliability  and  maintainability  on  the  acquisition  and 
support  of  weapons  systems  and  their  components. 

45.  My  job  requires  an  understanding  of  quality  control  concepts  such 
as  specification  compliance,  standardization  and  evaluation  pro- 
grams, inspection  routines,  etc. 

46.  My  job  requires  the  ability  to  understand  and/or  analyze  con- 
tractor proposals  in  such  areas  as  cost  estimation,  program 
scheduling,  control  pricing  techniques,  contractor  accounting 
techniques , etc . 

47.  In  my  job,  it  is  necessary  to  take  into  consideration  federal 
laws,  regulations,  or  policies  concerning  social,  environmental, 
or  energy  related  topics  such  as  OSHA,  EPA,  the  current  energy 
situation,  etc. 

48.  My  job  requires  the  ability  to  develop  models  that  will  allow 
evaluating  alternate  courses  of  action  prior  to  implementation. 

49.  My  job  requires  the  ability  to  understand  the  capabilities  and 
limitations  of  the  computer  as  an  aid  in  the  solution  of  manage- 
ment problems. 

50.  My  job  requires  the  ability  to  program  a computer. 

51.  My  job  requires  the  ability  to  understand  and/or  analyze  organi- 
zational climate  and  the  behavior  of  individuals  within  that 
organization. 

52.  My  job  requires  the  ability  to  verbally  inform,  convince,  and/or 
persuade  individuals  relative  to  ideas,  decisions,  and  concepts. 
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Please  use  the  following  responses: 


Strongly 

Disagree 

1 

Disagree 

1 

Slightly 

Disagree 

1 

Neither 
Agree  nor 
Disagree 

1 

Slightly 

Agree 

1 

Strongly 
Agree  Agree 

| | 

1 

A 

1 

B 

1 

C 

1 

D 

1 

E 

1 1 

F G 

53.  My  job  requires  the  ability  to  communicate  in  writing  in  such  a 
manner  as  to  inform,  convince  and/or  persuade  individuals  rela- 
tive to  ideas,  decisions,  and  concepts  (such  as  in  the  preparation 
of  reports,  correspondence,  etc.). 

54.  My  job  requires  an  understanding  of  economic  concepts  relating  to 
individual  organizations  such  as  marginal  costs,  time  value  of 
money,  etc.  (microeconomic  concepts) . 

55.  My  job  requires  an  understanding  of  societal  economic  concepts 
such  as  inflation,  gross  national  product,  balance  of  payments, 
etc.  (macroeconomic  concepts) . 

56.  My  job  requires  the  ability  to  logically  think  through  problems 
using  analytical  techniques  such  as  the  scientific  method,  etc. 

57.  My  job  does  not  require  an  advanced  education  such  as  that  pro- 
vided by  the  AFIT  School  of  Systems  and  Logistics  program. 

58.  My  job  is  commensurate  with  my  abilities. 

59.  The  skills  that  I acquired  from  my  AFIT  School  of  Systems  and 
Logistics  education  have  proven  useful  in  meeting  the  requirements 
of  my  job. 

60.  I could  do  my  job  effectively  without  an  AFIT  School  of  Systems 
and  Logistics  education. 

61.  My  AFIT  School  of  Systems  and  Logistics  education  might  be  better 
utilized  in  another  duty  assignment. 

62.  If  you  have  any  suggestions  for  improvement  of  the  AFIT  graduate 
education  program,  please  use  the  space  below  and  on  the  reverse 
to  write  them  down. 

THANK  YOU  FOR  YOUR  COOPERATION  IN  COMPLETING  THIS  QUESTIONNAIRE. 

PLEASE  ENCLOSE  THE  QUESTIONNAIRE  AND  THE  MACHINE  SCORABLE  ANSWER  SHEET 

IN  THE  RETURN  ENVELOPE  AND  PLACE  THE  ENVELOPE  IN  OUTGOING  OFFICIAL 

DISTRIBUTION . 

SCN : 79-56  (Expires  30  Apr  79) 
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SCHOOL 

ALUMNI 


AFIT 

OF  SYSTEMS  AND  LOGISTICS 
ROSTER  INFORMATION  SHEET 


We  need  to  update  our  alumni  roster  in  order  to  maintain 
contact  with  you.  Please  provide  the  following  information 
and  return  this  form  with  the  survey  or  mail  it  directly 
to  AFIT/LSGR,  Wright-Patterson  AFB , Ohio  45433. 

Private  Act  Statement:  We  are  authorized  by  10  U.S.C. 

Chapter  40,  and  E.O.  9397,  Nov  43,  to  request  information 
on  this  form.  The  principal  purpose  for  use  of  this 
information  is  to  update  the  AFIT  School  of  Systems  and 
Logistics  Alumni  Roster.  We  will  routinely  use  this  informa- 
tion to  maintain  correspondence  and  publication  contact 
between  the  School  and  alumni.  Your  disclosure  of  this 
information  is  voluntary. 

Name SSAN 

Hone  Mail  Address 


Business  or  Official  Mail  Address 


Current  Military  Status:  Active  Duty  Retired  Non-applicable 

Current  Military  Grade  or  Military  Grade  at  retiranent:  

Military  Service:  USAF  USA  USN  U34C  Other 

Current  Federal  Civil  Service  Status  Active  Retired  Non- 

applicable 

Current  GS  grade  or  GS  grade  at  retirement,  if  applicable:  

Graduate  degree (s)  earned? 
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APPENDIX  B 

PARAMETRIC  VALUES  FOR  QUESTIONS  14-18  AND  22-61 


TABLE  23 


\\ 


PARAMETRIC 

h 

VALUES  FOR  QUESTIONS  14-18  AND 

22-61 

Question 

Mean 

Median 

Mode 

Std.  Dev. 

Variance 

14 

4.831 

5.461 

6.0 

1.891 

3.577 

I 15 

4.662 

5.082 

6.0 

1.798 

3.231 

16 

5.059 

5.405 

6.0 

1.550 

2.402 

[j  17 

4.200 

4.235 

4.0 

1.530 

2.340 

1 18 

3.771 

3.932 

4.0 

1.388 

1.926 

ft  22 

6.019 

6.133 

6.0 

1.023 

1.047 

1 23 

5.780 

6.082 

6.0 

1.366 

1.866 

~ .a 

24 

2.617 

2.194 

2.0 

1.550 

2.403 

25 

5.643 

5.865 

6.0 

1.245 

1.550 

L 26a 

3.233 

3.195 

2.0 

1.498 

2.245 

5.136 

5.348 

6.0 

1.214 

1.473 

t 28 

4.991 

5.121 

6.0 

1.290 

1.663 

29 

5.064 

5.145 

6.0 

1.213 

1.472 

30 

4.920 

4.937 

4.0 

1.183 

1.399 

31 

4.204 

4.867 

6.0 

2.138 

4.571 

32 

4.241 

4.878 

6.0 

2.038 

4.152 

33 

4.977 

5.552 

6.0 

1.856 

3.443 

34 

4.159 

4.720 

6.0 

2.019 

4.077 

35 

4.026 

4.547 

5.0 

2.118 

4.486 

36 

4.088 

4.621 

5.0 

2.093 

4.381 

37 

4.436 

5.009 

6.0 

2.103 

4.424 

38 

5.328 

5.756 

6.0 

1.618 

2.619 

39 

4.309 

4.829 

5.0 

1.946 

3.787 

40 

5.052 

5.516 

6.0 

1.771 

3.136 

41 

4.005 

4.412 

2.0 

2.050 

4.204 

42 

3.932 

4.070 

2-0 

2.033 

4.134 

a 

These  are  negatively 

worded 

questions . 

Values  were 

not  reversed  in 

this  table  but  were 

reversed  when  computing 

the  usefulness  indices. 
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TABLE  23 — Continued 


Question 


3.564 

3.626 

4.319 

3.796 

4.324 

3.653 

4.833 

2.555 

5.650 

6.468 

6.454 

3.998 

3.593 

5.334 

3.789 

4.219 

5.490 

4.492 

4.887 


Median 


3.196 

3.500 

4.825 

3.689 
4.833 
3.500 
5.273 
1.986 
6.006 

6.689 
6.701 
4.535 
3.578 
5.729 
3.463 
4.719 
5.831 
4.811 
5.366 


Std.  Dev. 


Variance 


0 

2.092 

4.375 

0 

2.057 

4.230 

0 

1.938 

3.754 

0 

2.142 

4.586 

0 

1.974 

3.896 

0 

1.955 

3.823 

0 

1.873 

3.509 

0 

1.722 

2.966 

0 

1.511 

2.283 

0 

.900 

.811 

0 

.962 

.926 

0 

1.975 

3.902 

0 

1.918 

3.680 

0 

1.651 

2.725 

1 

1.984 

3.936 

2.057 

4.233 

1.503 

2.260 

1.631 

2.662 

0 

1.823 

3.323 
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These  are  negatively  worded  questions.  Values  were  not  reversed  in  this 
table  but  were  reversed  when  computing  the  usefulness  indices. 
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INDEX  G2 — PARAMETRIC  VALUES  FOR  QUESTIONS  22-25,  59 
FOR  RATED  AND  NONRATED  GRADUATES3 
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INDEX  G3 — PARAMETRIC  VALUES  FOR  QUESTIONS  26-30 
FOR  RATED  AND  NONRATED  GRADUATES3 
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TABLE  28 

INDEX  G4— PARAMETRIC  VALUES  FOR  QUESTIONS  31-56 
FOR  RATED  AND  NONRATED  GRADUATES 


Pilots 

Question  Mean  Median  Mode 


4.126  4.883 
3.945  4.520 
4.354  4.960 


3.394 

2.806 

3.512 

2.692 

3.661 

3.154 

3.024 

4.438 

5.142 

5.710 

Std.  Dev. 


Variance 


2.229 

4.968 

2.001 

4.005 

1.958 

3.834 

1.961 

3.844 

2.228 

4.966 

2.208 

4.877 

2.125 

4.515 

1.781 

3.170 

1.920 

3.686 

1.862 

3.467 

2.126 

4.521 

1.986 

3.945 

1.982 

3.927 

1.835 

3.366 

2.006 

4.024 

2.120 

4.494 

2.020 

4.080 

1.828 

3.343 

1.985 

3.940 

1.485 

2.206 

1.624 

2.638 

1.105 

1.220 

1.146 

1.313 

1.995 

3.979 

1.875 

3.514 

1.828 

3.342 

Question 

Mean 

Median 

Mode 

Std.  Dev. 

Variance 

31 

3.639 

3.750 

1.0 

2.201 

4.843 

32 

3.843 

4.588 

6.0 

2.086 

4.353 

33 

4.687 

5.225 

6.0 

2.006 

4.023 

34 

3.530 

3.188 

2.0 

1.896 

3.594 

35 

3.663 

3.200 

1.0 

2.221 

4.934 

36 

3.711 

3.625 

2.0 

2.167 

4.696 

37 

3.831 

4.000 

2.0 

2.262 

5.118 

38 

5.145 

5.683 

6.0 

1.822 

3.320 

39 

3.855 

4.143 

5.0 

1.939 

3.759 

40 

4.566 

5.063 

5.0 

1.964 

3.858 

41 

3.566 

2.917 

2.0 

2.114 

4.468 

42 

3.410 

2.714 

2.0 

2.048 

4.196 

43 

3.120 

2.295 

1.0 

2.009 

4.034 

44 

3.120 

2.341 

1.0 

1.959 

3.839 

45 

4.000 

4.579 

5.0 

2.000 

4.000 

46 

3.205 

2.391 

2.0 

2.023 

4.092 

47 

3.964 

4.528 

5.0 

2.075 

4.304 

48 

3.048 

2.327 

2.0 

1.912 

3.656 

49 

3.892 

4.438 

5.0 

2.078 

4.317 

50 

1.988 

1.641 

1.0 

1.375 

1.890 

51 

5.566 

6.023 

7.0 

1.654 

1.736 

52 

6.277 

6.617 

7.0 

1.172 

1.373 

53 

6.193 

6.598 

7.0 

1.348 

1.816 

54 

3.386 

2.938 

2.0 

1.950 

3.801 

55 

3.060 

2.391 

2.0 

1.863 

3.472 

56 

4.687 

5.059 

6.0 

1.912 

3.657 

TABLE  28 — Continued 


Question 

Mean 

Nonrated 

Median  Mode 

Std.  Dev. 

Variance 

31 

4.293 

4.918 

6.0 

2.102 

4.419 

32 

4.352 

4.976 

6.0 

2.029 

4.118 

33 

5.140 

5.658 

6.0 

1.785 

3.186 

34 

4.394 

4.966 

6.0 

1.993 

3.974 

35 

4.177 

4.696 

5.0 

2.062 

4.253 

36 

4.222 

4.745 

5.0 

2.045 

4.183 

37 

4.598 

5.172 

6.0 

2.055 

4.222 

38 

5.390 

5.776 

6.0 

1.553 

2.412 

39 

4.498 

4.991 

5.0 

1.  917 

3.675 

40 

5.180 

5.606 

6.0 

1.708 

2.919 

41 

4.169 

4.636 

5.0 

2.003 

4.001 

42 

4.058 

4.347 

2.0 

2.027 

4.109 

43 

3.772 

4.014 

2.0 

2.084 

4.341 

44 

3.848 

4.211 

ED 

2.064 

4.262 

45 

4.427 

4.905 

EH 

1.906 

3.633 

46 

3.998 

4.447 

2.0 

2.126 

4.518 

47 

4.397 

4.862 

5.0 

1.948 

3.793 

48 

3.821 

3.973 

kSEI 

1.959 

3.836 

49 

5.071 

5.500 

Ell 

1.758 

3.090 

50 

2.715 

2.122 

1.0 

1.778 

3.161 

51 

5.658 

5.984 

1.469 

2.159 

52 

6.522 

6.716 

7.0 

0.804 

0.646 

53 

6.530 

6.739 

7.0 

0.844 

0.712 

54 

4.190 

4.700 

5.0 

1.940 

3.764 

55 

3.774 

3.007 

5.0 

1.903 

3.626 

56 

5.495 

5.833 

6.0 

1.543 

2.380 
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APPENDIX  E 


PARAMETRIC  VALUES  FOR  INDICES  Gl,  G2,  G3 , G4 , AND  G5 
BASED  ON  DIFFERENT  GRADUATING  YEAR  GROUPS 
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Question  24  is  negatively  worded.  Values  were  not  reversed  in  this  table 
but  were  reversed  when  computing  the  usefulness  indices. 
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Question  26  is  negatively  worded.  Values  were  not  reversed  in  this  table 
but  were  reversed  when  computing  the  usefulness  indices. 
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TABLE  33 


INDEX  G4 — PARAMETRIC  VALUES  FOR  QUESTIONS  31-56 


FOR 

GRADUATING  YEAR  GROUPS 

Question 

Mean 

1978 

Median  Mode 

Std.  Dev. 

Variance 

31 

4.247 

4.972 

6.0 

2.273 

5.167 

32 

4.041 

4.600 

2.0 

2.231 

4.977 

33 

4.557 

5.135 

5.0 

2.041 

4.166 

34 

3.897 

4.519 

5.0 

1.912 

3.656 

35 

4.103 

4.647 

7.0 

2.252 

5.073 

36 

4.155 

4.706 

7.0 

2.228 

4.965 

37 

4.464 

5.031 

7.0 

2.204 

4.855 

38 

5.289 

5.714 

6.0 

1.652 

2.728 

39 

4.021 

4.526 

o 

• 

n 

2.061 

4.250 

40 

4.938 

5.440 

6.0 

1.853 

3.434 

41 

4.082 

4.525 

5.0 

2.100 

4.410 

42 

3.959 

3.154 

1.0 

2.056 

4.227 

43 

3.175 

2.173 

1.0 

2.213 

4.896 

44 

3.010 

2.212 

1.0 

2.023 

4.094 

45 

4.412 

4.942 

5.0 

1.919 

3.682 

46 

3.701 

3.063 

2.0 

2.292 

5.253 

47 

4.494 

4.893 

7.0 

2.102 

4.419 

48 

3.526 

3.250 

1.0 

2.077 

4.314 

49 

4.515 

5.095 

5.0 

2.112 

4.461 

50 

2.835 

2.068 

1.0 

1.988 

3.952 

51 

5.577 

5.926 

7.0 

1.573 

2.476 

52 

6.433 

6.678 

7.0 

0.978 

0.956 

53 

6.330 

6.664 

7.0 

1.170 

1.369 

54 

3.701 

3.917 

1.0 

2.204 

4.858 

55 

3.526 

3.429 

1.0 

2.021 

4.085 

56 

5.113 

5.552 

6.0 

1.773 

3.143 

99 
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1977 


Question 

Mean 

Median 

Mode 

Std.  Dev. 

Variance 

31 

4.307 

4.952 

6.0 

2.134 

4.555 

32 

4.168 

4.667 

6.0 

2.030 

4.121 

33 

4.901 

5.407 

6.0 

1.786 

3.190 

34 

3.564 

2.950 

2.0 

1.931 

3.728 

35 

3.990 

3.800 

7.0 

2.360 

5.570 

36 

4.277 

4.906 

7.0 

2.254 

5.082 

37 

4.446 

4.969 

7.0 

2.109 

4.450 

38 

5.386 

5.769 

6.0 

1.543 

2.379 

39 

3.010 

4.250 

2.0 

1.910 

3.650 

40 

5.089 

5.482 

6.0 

1.625 

2.642 

41 

3.792 

3.333 

2.0 

2.056 

4.226 

42 

4.079 

4.438 

5.0 

2.082 

4.334 

43 

3.020 

2.200 

2.0 

1.990 

3.960 

44 

3.188 

2.303 

2.0 

2.038 

4.154 

45 

4.257 

4.667 

5.0 

1.927 

3.713 

47 

3.683 

3.250 

1.0 

2.245 

5.039 

47 

4.594 

5.114 

6.0 

1.919 

3.684 

48 

3.139 

2.429 

2.0 

1.806 

3.261 

49 

4.743 

5.114 

7.0 

1.917 

3.673 

50 

2.327 

1.732 

1.0 

1.692 

2.862 

51 

6.196 

6.196 

7.0 

1.557 

2.423 

52 

6.495 

6.698 

7.0 

0.867 

0.752 

53 

6.564 

6.723 

7.0 

0.727 

0.528 

54 

3.465 

3.313 

N> 

• 

o 

1.890 

3.571 

55 

3.188 

2.667 

2.0 

1.782 

3.174 

56 

5.260 

5.707 

6.0 

1.703 

2.901 
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1976 


Question 

Mean 

Median 

Mode 

Std.  Dev. 

Variance 

31 

4.333 

5.017 

5.0 

2.051 

4.206 

32 

4.287 

4.864 

6.0 

1.963 

3.851 

33 

4.880 

5.500 

6.0 

1.771 

3.135 

34 

4.213 

4.763 

6.0 

2.010 

4.038 

35 

4.306 

4.938- 

6.0 

2.159 

4.663 

36 

4.426 

5.056 

6.0 

2.083 

4.340 

37 

4.620 

5.167 

7.0 

2.090 

4.369 

38 

5.269 

5.709 

6.0 

1.550 

2.404 

39 

4.417 

5.855 

5.0 

1.762 

3.105 

40 

4.991 

5.403 

6.0 

1.655 

2.738 

41 

4.028 

4.409 

2.0 

1.974 

3.896 

42 

4.037 

4.250 

2.0 

2.014 

4.055 

43 

3.037 

2.194 

1.0 

2.042 

4.168 

44 

3.617 

3.444 

1.0 

2.109 

4.446 

45 

4.514 

4.897 

5.0 

1.777 

3.158 

46 

4.093 

4.594 

2.0 

2.187 

4.784 

47 

4.383 

4.854 

6.0 

1.877 

3.522 

48 

3.477 

3.031 

2.0 

1.885 

3.554 

49 

4.888 

5.266 

5.0 

1.717 

2.950 

50 

2.607 

2.000 

1.0 

1.763 

3.109 

51 

5.505 

5.803 

6.0 

1.450 

2.101 

52 

6.374 

6.578 

7.0 

0.927 

0.859 

53 

6.346 

6.527 

7.0 

0.912 

0.832 

54 

4.028 

4.286 

2.0 

1.940 

3.763 

55 

3.949 

3.417 

2.0 

1.910 

3.649 

56 

5.467 

5.708 

6.0 

1.396 

1.949 
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1975 


Question 

Mean 

Median 

Mode 

Std.  Dev. 

Variance 

31 

3.809 

4.000 

2.0 

2.220 

4.929 

32 

3.966 

4.705 

5.0 

2.097 

4.397 

33 

4.685 

5.294 

6.0 

2.003 

4.014 

34 

4.146 

4.789 

5.0 

2.114 

4.467 

35 

3.719 

3.600 

2.0 

2.127 

4.522 

36 

3.955 

4.250 

5.0 

2.028 

4.112 

37 

4.202 

4.765 

6.0 

2.084 

4.345 

38 

5.371 

5.839 

6.0 

1.668 

2.781 

39 

4.124 

4.684 

5.0 

2.066 

4.269 

40 

5.034 

5.477 

6.0 

1.748 

3.056 

41 

3.011 

4.417 

2.0 

2.081 

4.309 

42 

4.169 

4.800 

6.0 

2.181 

4.755 

43 

3.674 

3.600 

2.0 

2.152 

4.631 

44 

3.528 

3.143 

1.0 

2.138 

4.570 

45 

4.753 

5.238 

6.0 

1.873 

3.506 

46 

3.629 

3.650 

1.0 

2.107 

4.441 

47 

4.506 

5.000 

5.0 

1.972 

3.889 

48 

3.899 

4.250 

5.0 

1.954 

3.819 

49 

4.674 

5.104 

5.0 

1.882 

3.540 

50 

2.506 

1.920 

1.0 

1.772 

3.139 

51 

5.719 

6.043 

7.0 

1.390 

1.932 

52 

6.483 

6.676 

7.0 

0.813 

0.662 

53 

6.303 

6.644 

7.0 

1.122 

1.259 

54 

3.966 

4.565 

5.0 

1.991 

3.965 

55 

3.742 

4.000 

5.0 

1.957 

3.830 

56 

5.292 

5.690 

6.0 

1.667 

2.777 
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Question 


Mean 


5 


5.680 
82 
86 
4.102 
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1971-74 

Median  Mode  £ 


31 

4.074 

4.727 

6 

32 

4.165 

4.875 

6 

33 

4.972 

5.518 

6 

34 

4.182 

4.772 

6 

35 

3.818 

4.031 

2 

36 

3.775 

3.769 

2 

5.277 

5.755 

4.249 

4.858 

5.000 

5.555 

3.933 

4.400 

3.786 

3.768 

3.711 

3.974 

4.067 

4.640 

3.560 

3.045 

4.123 

4.708 

4.623 

3.458 

4.739 

5.222 

6.575 


Std.  Dev. 


Variance 


0 

2.167 

4.695 

0 

2.057 

4.230 

0 

1.876 

3.520 

0 

2.068 

4.276 

0 

2.070 

4.283 

0 

2.077 

4.316 

0 

2.154 

4.641 

0 

1.711 

2.926 

0 

1.991 

3.962 

0 

1.910 

3.648 

0 

2.128 

4.527 

0 

2.040 

4.162 

0 

2.051 

4.208 

0 

2.042 

4.171 

0 

2.052 

4.211 

0 

2.102 

4.417 

0 

2.046 

4.186 

0 

1.972 

3.889 

0 

1.916 

3.670 

0 

1.698 

2.885 

0 

1.525 

2.325 

0 

0.960 

0.922 

0 

1.024 

1.049 

0 

1.970 

3.880 

0 

1.939 

3.760 

0 

1.717 

2.948 

TABLE  33 — Continued 


1 

1967-70 

Question 

Mean 

Median  Mode 

Std.  Dev. 

Variance 

4.454 

4.638 

5.539 

4.559 

4.309 

4.309 

4.770 

5.342 

4.743 

4.204 

4.132 

3.862 

4.178 

4.184 

4.322 

4.217 

4.224 

4.046 

5.276 

2.711 

5.566 

6.480 

6.520 

4.211 

3.836 

5.447 


5.025 

5.125 

5.948 

5.071 

4.750 
4.773 

5.250 
5.700 
5.100 
5.544 
4.531 

3.750 
4.643 
4.643 
4.773 
4.647 
4.738 
4.524 
5.600 
2.268 
5.895 
6.674 
6.691 
4.717 

4.250 
5.744 
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31 

4.667 

5.500 

6.0 

2.229 

4.970 

32 

4.833 

5.500 

6.0 

2.038 

4.152 

33 

5.083 

6.000 

6.0 

2.234 

4.992 

34 

5.250 

5.750 

6.0 

1.913 

3,659 

35 

4.833 

5.500 

6.0 

2.082 

4.333 

36 

4.500 

4.500 

6.0 

1.977 

3.909 

37 

5.250 

5.500 

5.0 

1.960 

3.841 

38 

6.417 

6.500 

• 

o 

0.669 

0.447 

39 

5.500 

5.833 

7.0 

1.624 

2.636 

40 

5.667 

6.100 

6.0 

1.723 

2.970 

41 

5.000 

5.500 

6.0 

1.859 

3.455 

42 

4.167 

3.500 

2.0 

2.125 

4.515 

43 

4.417 

5.000 

7.0 

2.539 

6.447 

44 

4.000 

4.833 

1.0 

2.412 

5.181 

45 

5.083 

5.300 

5.0 

1.881 

3.538 

46 

4.333 

5.000 

5.0 

2.229 

4.970 

47 

4.833 

5.500 

5.0 

2.250 

5.061 

48 

4.500 

4.833 

7.0 

2.316 

5.364 

49 

5.417 

6.100 

6.0 

2.021 

4.083 

50 

2.500 

1.500 

1.0 

1.931 

3.727 

51 

6.417 

6.643 

7.0 

0.793 

0.629 

52 

6.750 

6.833 

7.0 

0.452 

0.205 

53 

7.000 

7.000 

7.0 

0.000 

0.000 

54 

5.667 

6.167 

7.0 

1.670 

2.788 

55 

5.000 

5.250 

5.0 

1.907 

3.636 

56 

6.083 

6.750 

7.0 

1.621 

2.629 

1 
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Questions  57,  60,  and  61  were  negatively  worded.  Values  were  not 
reversed  in  this  table  but  were  reversed  when  computing  the  usefulness  indices 
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